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Abstract 

The fundamental theorem of the theory of optimal control, the Pontryagin Maximum 
Principle (PMP), is extended to the setting of almost Lie (AL) algebroids - geometrical 
objects generaHzing Lie algebroids. This formulation of the PMP may be viewed as a scheme 
comprising reductions of optimal control problems, like the Euler-Poincare equations arise 
as reductions of the Euler-Lagrange equations for the rigid body. The framework is based 
on a very general concept of homotopy of admissible paths and geometry of AL algebroids 
and goes back to some ideas of the Lagrangian and Hamiltonian formalisms in this general 
setting. 
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1 Introduction. 

It is a well-known phenomena in Analytical Mechanics and Control Theory that symmetries of a 
system lead to reductions of its degrees of freedom. It is also well understood that such a reduction 
procedure is very often not only purely computational but is associated with a reduction of the 
corresponding geometrical structures which are hidden behind our problem. Let us mention 
reductions of Hamiltonian systems associated with symplectic reductions of the phase space. In 
the best situation we end up with another phase space of the form of a cotangent bundle. Quite 
often, however, the resulted symplectic manifold is no longer a cotangent bundle, so we have 
learned to deal with Hamiltonian systems on an arbitrary symplectic manifold. What is more, 
the reduction which makes sense from the point of view of Physics need not to be symplectic, so 
we have learned to deal with Poisson reductions. This means that we have to incorporate Poisson 
manifolds into the theory of Hamiltonian systems, if only we want to understand properly and 
to apply natural reduction procedures. The best known example of this type is probably the 
reduction for the rigid body: from the cotangent bundle T* S0(3) of the group S0(3) playing 
the role of the configuration space to the linear Poisson structure of 5o(3)*, the dual to the Lie 
algebra structure of so (3). 

We have clearly a similar situation on the Lagrangian side of the formalism for both, geomet- 
rical and variational formulation. Here, however, the situation is conceptually more complicated. 
This is due to the fact that not only the space on which the Lagrangian is defined is reduced, 
like TS0(3) to so (3) in the case of the rigid body, but also the variations have to be reduced 
and the new concept of what a variation is becomes much less intuitive than the standard one 
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(see for instance [5]). The nicest geometrical situation is when we obtain after the reduction an 
object resembling a tangent bundle, i.e. a vector bundle with certain Lie algebra structure in 
the module of its sections - a Lie algebroid. In [5] several reduced Lagrangian systems have been 
recognized as related to, in fact. Lie algebroids, although different terminology have been used. 

On the other hand, a direct attempt to construct a 'mechanics' starting from a Lie groupoid or 
a Lie algebroid have been originated by A. Weinstein [35] and P. Libermann [22] and developed in 
different directions by many authors ([ZllHlET], [24]- [28]). The concept of optimal control in this 
context has been studied as well [HI [MIES]. It was also observed that one can develop Geometrical 
Mechanics together with the Euler-Lagrange and Hamilton equations as a formalism based on 
more general objects than Lie algebroids ([H] [12]). They were introduced in [16] under the 
name (general) algebroids, as the Jacobi identity and even skew-symmetry of the corresponding 
brackets is irrelevant. This, in turn, is due to the fact that a geometric approach to Analytical 
Mechanics originated by W. M. Tulczyjew ([3TJ [32j [33]) makes use, in fact, only of a double 
vector bundle structure of T*TM ~ TT*M ~ T*T*M, where M is the configuration space of the 
system. On the other hand, the Jacobi identity plays the role of an integrability condition which 
allows to integrate (at least locally) a Lie algebroid to a Lie groupoid (see for instance [9]), so to 
interpret a system on the Lie algebroid as a reduction from the Lie groupoid. In this picture the 
role of tangent prolongations of paths in the configuration manifolds are played by admissible 
paths in the total bundle E of the Lie algebroid, so the paths whose anchor coincides with the 
tangent prolongation of their projections to configuration manifold. The key tool in constructing 
the Lie groupoid is the concept of a homotopy of admissible paths in a Lie algebroid. As we 
show in this paper, this concept works well even in a slightly more general framework of what 
we call almost Lie algebroids. 

The aim of our work is to extend the fundamental theorem of the theory of optimal control 
- the Pontryagin Maximum Principle (PMP) - to the setting of almost Lie algebroids. Our 
motivation comes from the theory of reductions of Lagrangian and control systems (see for 
instance [SU [SOj [5]). Some differential versions of the PMP in more general settings of this type 
have been already indicated in [H|26l[l2], but the full version we present here is, to our knowledge, 
completely novel. We decided to present a version of the PMP for almost Lie algebroids (AL 
algebroids for short) - more general than the version for just Lie algebroids - as it potentially 
admits a wider spectrum of possible applications. This is the mathematical side of the problem, 
although it is not easy to find concrete applications in this general framework, since the standard 
thinking about control problems in more general geometric setting is to pass through a reduction. 
We believe, however, that one can find a natural examples of control systems on almost Lie 
algebroids in the context of constraints, as it has been done for skew- algebroids describing systems 
under nonholonomic constraints [13j . 

To explain briefly the result, let us note that an AL algebroid is determined by certain linear 
bi-vector field 11 distinguished on the dual E* of a vector bundle t : E ^ M . This bi-vector 
field defines, in particular, a vector bundle morphism p : E TM, called the anchor of the AL 
algebroid structure on E, and the Hamiltonian vector field Xh associated with any function 
H on E* , defined in the standard way as the contraction Xh = MJ?n. The classical model is 
the tangent bundle E = TM with the Poisson tensor on T*M corresponding to the canonical 
symplectic structure. The anchor equals the identity in this case. Other standard examples are 
finite-dimensional real Lie algebras E = q with the corresponding Lie-Poisson tensors on their 
duals Q* and trivial anchor maps (M is a single point in these cases). On E we can consider 
admissible paths, i.e. piece-wise continuous maps 7 : [toi^i] ~^ E such that the projection 
x{t) = T{'j(t)) of 7(t) on M is piece-wise and x{t) = p{-y{t)). On admissible paths we have 
an equivalence relation 7 ~ cr interpreted as a reduction of homotopy equivalence (with fixed 
end-points). The concept of this equivalence in the case of AL algebroids is the crucial and 
non-trivial part our framework. Note that equivalent paths need not to be defined on the same 
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time interval. For an admissible path a we denote with [a] the equivalence homotopy class of a. 

A control system is defined by a continuous map f : M x U —> E, where U is a topological 
space of control parameters, such that for each u & U the function fu = fi-,u) is a section of 
class of the bundle E. Every admissible control, i.e. a piece-wise continuous path u{t) in U, 
gives rise to a piece-wise path in M defined by the differential equation 

x{t)=p{f{x{t),u{t))) (1) 

with the initial condition x(to) = xq, and to an admissible path ^{t) = f{x{t),u{t)) (we will 
call it admissible path induced by the control u{t)) covering x{t). An optimal control problem 
for this control system is associated with a class [a] of an admissible path a with the initial 
base-point xq and a cost function L : M x U ^ and the question is to find an admissible 
control u : [to,ti] — > U (the time interval is to be found as well) such that 

(a) the admissible path f{x{t),u{t)) in E induced by u{t) belongs to the homotopy class [a]; 

(b) the total cost J^^ L{x{t),u{t))dt is minimal among admissible controls satisfying (a). 

Theorem 1.1. Let u : [to,ti] — > U be a solution of the above optimal control problem. There 
exists a curve z{t) : [to,ti] — > E* (with initial base-point xq) and a constant zq < which satisfy 
the following conditions: 

• the curve z{t) is a trajectory of the time- dependent family of Hamiltonian vector fields Xhi 
associated with the Hamiltonians Ht{z) = H{z,u{t)), where 

H{z, u) = (/ (vr(z), u) , z)^ + zqL {tt{z),u) ; 

• the pair u(t) and z{t) satisfies the "Maximum Principle" 

H{z{t),u{t)) = sup H{z{t),v) 

at every point of continuity of the control u; 

• if Zq = the covector z{t) is nowhere-vanishing; 

• H{z{t),u{t)) = at every point of continuity of the control u. 

Although the theorem looks quite similar to the standard one, in formulating and to proving 
it one encounters at least three difficulties in comparison with the classical case. First of all, the 
concept of homotopy for admissible paths in an AL algebroid, similar to the one introduced in 
[9] for Lie algebroids, is much less intuitive than the standard one and technically complicated. 
Second, because we accept various sets of control parameters, in particular two-point 'switch-on 
- switch-off', we must consequently accept non-continuous 'idle' variations that strongly differs 
from the standard concept of variation in Analytical Mechanics. This leads to non-continuous 
admissible paths as trajectories in our algebroid even if their projections to the base - solutions of 
the differential equation ([T]) - are continuous which corresponds to the classical case. Because of 
that, the concept of homotopy must consequently go beyond differentiable and even continuous 
cases, so the methods developed in [9] are no more directly applicable. And third, working with 
AL algebroids and our general homotopies makes the final topological argument in the proof of 
the PMP much more delicate than in the standard case. 

Despite of all these problems, we get an elegant formulation of the PMP for almost Lie 
algebroids (theorem 16. but for the price of dealing with substantial technical difficulties in 
defining and working with non-continuous homotopy of admissible paths. Of course, looking 
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at the reduction procedures is only our motivation, since almost Lie algebroids are not reduced 
objects in general, like Lie algebroids are. 

The paper is organized as follows. In Section 2 we recall what are double vector bundles and 
define almost Lie algebroids and in Section 3 we introduce tangent (complete) lifts of sections 
of an algebroid and Hamiltonian vector fields in this setting. Section 4 we spend on introducing 
the concept of homotopy of admissible paths in almost Lie algebroids. In section 5 we state 
the problem defining control systems in our general setting. The Maximum Principle is stated 
and proved in Section 6 modulo two technical lemmata whose proofs are postponed to Section 
7. We end up with some examples in Section 8. To keep the size of the paper reasonable, we 
concentrate here on the theory and we present only two examples showing how certain known 
results can be derived directly and simply from our theory. 

2 Almost Lie algebroids. 

We start with introducing some notation and the concept of a general Lie algebroid as it has 
been used for variational calculus in [12]. For details the reader can consult [TTJ [12] and the 
references therein. 

Let M be a smooth manifold and let {x'^), a = 1, . . . , n, be a coordinate system in M. We 
denote with tm- TM — > M the tangent vector bundle and by ttm- T*M — > M the cotangent 
vector bundle. We have the induced (adapted) coordinate systems {x°-,x^) in TM and {x°',pi)) in 
T*M. More generally, let r : — > M be a vector bundle and let it: E* — > M be the dual bundle. 
Let (ei, . . . , em) be a basis of local sections of r : E ^ M and let (e^, . . . , e^) be the dual basis 
of local sections of vr: E* —i- M. We have the induced coordinate systems: {x°',y^),y^ = i(e*) 
in E, and {x"" , Ci) j d = '-(cj) in E* , where the linear functions t(e) are given by the canonical 
pairing L{e){vx) = {e{x),Vx). Thus we have local coordinates 

(x^y^i^^^■) inTS, (x«,ei,i',4) inT^*, 
{x'',y\pb,7rj) mJ*E, {x'',^i,pb,^) mJ*E*. 

The cotangent bundles T*E and T*E* are examples of so called double vector bundles (fibred 
over E and E*) which are canonically isomorphic 

T*E* ~ T*E ^ E . 

E* 

In particular, all arrows correspond to vector bundle structures and all pairs of vertical and 
horizontal arrows are vector bundle morphisms. The double vector bundles have been recently 
characterized [H] in a simple way as two vector bundle structures whose Euler vector fields 
commute. The above double vector bundles isomorphism 

TZr-.l^E — >J*E* (2) 

can be chosen being simultaneously an anti-symplectomorphism. In local coordinates, TZr is 
given by 

TZr{x°',y\p}„TTj) = {x"-,'n-i,-pb,y^). 

This means that we can identify coordinates ttj with coordinates (p^ with y-^, and use the 
coordinates {x'^,y'^,Pb,(,j) in '^*E and the coordinates {x"',(,i,pb,y^) in T*E*, in full agreement 
with dl). 
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It is well known that Lie algebroid structures on a vector bundle E correspond to linear 
Poisson tensors on E* . A 2-contravariant tensor IT on E* is called linear if the corresponding 
mapping 11: T*E* — s- TE* induced by contraction, = ii/H, is a morphism of double vector 
bundles. One can equivalently say that the corresponding bracket of functions is closed on 
(fiber-wise) linear functions. The commutative diagram 

T*E* -^TE* , 




T*E 



describes a one-to-one correspondence between linear 2-contravariant tensors 11 on E* and mor- 
phisms of double vector bundles A covering the identity on E*: 

T*E ^T^;* (3) 




In local coordinates, every such A is of the form 

A(x^y^p,,e,) = ix'^,C^,piix)y^c'l^{x)y'C, + a^{x)pa) (4) 

(summation convention is used) and it corresponds to the linear tensor 

Ha = 4(a;)efc% ® % + Pi (a;)% ® d^t - (j';{x)d^a d^^. 

The morphisms JSj has been called an algebroid in [16], while a Lie algebroid is an algebroids for 
which the tensor IIa is a Poisson tensor. An algebroid we will call a skew algebroid if the tensor 
IIa is skew-symmetric. 

Theorem 2.1. An algebroid structure {E,A) can be equivalently defined as a bilinear bracket 
[■,-]a on the space Sec{E) of sections of t: E M, together with vector bundle morphisms 
p, a: E ^ TM (the left anchor and the right anchor), such that 

[fX,gY]A = f ■ p{X){g)Y - g ■ a{Y){f)X + fg[X, Y]a 

for all f,g £ C°°(M), X,Y G Sec{E). The bracket and the anchors are related to the bracket 
{^p,^p}u^ = (n A 5 d(/9 (g) d-i/;) in the algebra of functions on E* associated with the 2-contravariant 
tensor IIa by the formulae 

ii[X,Y]A) = {i{X),t{Y)}n^, n*{p{X)if)) = {.(X),7r*/W, vr*(a(X)(/)) = {n* f, L{X)}n^ ■ 

Let us stress that any Lie algebroid is a skew algebroid, so that the anchors coincide p = a. 
We have therefore a unique anchor which, automatically, induces a morphism of the Lie algebroid 
E into TM with the bracket of vector fields, i.e. p{[X,Y]a) = [p{X), p{Y)] (see the discussion 
about this and similar problems in [lO]). We assume these properties to define almost Lie 
algebroids. 
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Definition 2.2. An almost Lie algebroid (AL algebroid shortly) is a skew algebroid {E, A) whose 
anchor p = a : E ^ JM is an algebroid morphism, 

p{[X,Y]^) = [p{X),p{Y)]. (5) 



Of course, Lie algebroids are AL algebroids, but the class of the latter ones is broader: for 
instance all skew-algebra bundles, p = a = 0, are AL algebroids independently what are the 
skew brackets in fibers. 

Since the dual bundles of vr^ : J*E — E and Tvr : JE* — > JM are, respectively, te '■ TE E 
and Tr : TE — TM, the dual to A is a relation k = kj\ : TE — |>T£^. It is a uniquely defined 
smooth submanifold k in TE x TE consisting of pairs {v,v') such that p{te{v')) = Tt{v) and 

for any v* G T*^^^,^ii^, where (•, •)tt is the canonical pairing between TE and TE*, and {■,-)te 
is the canonical pairing between TE and T*E. We will write k : v — \> v' instead of {v,v') G k. 
This relation can be put into the following diagram of "double vector bundle relations" 

TE< TE (6) 




The relation 




is a vector bundle morphism of the second kind, i.e. it is represented by linear maps of the fiber 
TE over v € TM into the fibers TgE for all e G E such that p{e) = v. This is also an example of a 
morphism of Lie groupoids in the sense introduced and exploited by S. Zakrzewski [37]. To such 
relations we will refer therefore as to Zakrzewski morphisms. The expression of the Zakrzewski 
morphism ([H), dual to A, in local coordinates reads 

K : (x^ Y\ pi{x)y\ Y^) -> al{x)Y\ Y^ + ci,(x)/Y') . (7) 

It is easy to see that k = for skew algebroids. 

A canonical example of a mapping A in the case oi E = TM is given by A = Am = cf^ 
- the inverse to the Tulczyjew isomorphism um '■ TT*M — > T*TM [HI]. The dual Zakrzewski 
morphism is in this case the well-known 'canonical flip' km ■ TTM TTM. Since aM is an 
isomorphism, km is a true map, in fact - an isomorphism of the corresponding two vector bundle 
structures as well. 

A C -curve 7 : R — > (or a C^-path7 : [to,ti] E) in an algebroid E we call admissible (or 
shortly E-path), if the tangent prolongation ¥(7) = (7,7) of its projection 7 = r o 7 coincides 
with its anchor: 

T(7)=/>(7(i))- (8) 
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A curve (path) in the canonical Lie algebroid TM is admissible if and only if it is a tangent 
prolongation of its projection on M . If we denote J^°^E the subset of T£^ consisting of holonomic 
vectors, 

T^°'i? = {veJE: Jt{v) = p{te{v))} , (9) 

then admissible curves (paths) in the algebroid E can be characterized as those curves (paths) 
whose tangent prolongations lay in 1^°^E. The set of holonomic vectors J^°^E can be equivalently 
characterized as the subset in IE which is mapped via Tp : JE —> TTM to classical holonomic 
vectors T^M = {« € TTM : km{u) = n}, that justifies the name. In other words, 

j'^"^E = {Jp)-^{J^M). 

Note also that J^°^E is canonically an affine bundle over E modelled on the vertical bundle 
\IE C JE. In local coordinates, J^°^E as submanifold in JE is characterized by the equations 
x°' = pf{x)y\ so {x°-,y\y^) can serve as local coordinates in J^°^E. It is easy to see that, for 
skew algebroids, k(T'*°'£;) = J^°^E. 

Observe that equation ([8]) makes sense also if we weaken the regularity conditions imposed 
on 7. Namely, it is enough that 7 is continuous over C^-base curve. Prom now on we will speak 
of E'-paths in this sense. 

Note also that for a general algebroid we may speak of £^-paths with respect to the left or 
right anchor. 



3 The tangent algebroid lift and Hamiltonian vector fields. 

For a tensor field K G Sec(^®'=), we can define the vertical lift v^(K) G Sec(T®'=S) (cf. [El 
In local coordinates, 

yr{r-'e^, ® • • • ® e,J = r-'^dy^, ®---®dy.,. (10) 

A particular case of the vertical lift is the lift yj{K) of a contravariant tensor field K on M into 
a contravariant tensor field on TM. It is well known (see [Ml [IS]) that in the case oi E = TM we 
have also the tangent lift of contravariant tensors on M into contravariant tensors on TM which 
is a vj-derivation. It turns out that the presence of such a lift for a vector bundle is equivalent 
to the presence of an algebroid structure. Note first that we can extend A naturally to mappings 

(cf. mm) 

A®'': ®%J*E ^J(^l^E*, r>0. 

Theorem 3.1. [EKIS] Let {E,A) be an algebroid. For K £ Sec{E^''), k>0, the equality 

4df(i^)) = dT(^(i^))oA«^ (11) 

defines a tensor field dj{K) S Sec(T®'^£') which is linear and the mapping 

df : Sec{E^'') -^Sec{J^''E) 

is a Yr-derivation of degree 0. Conversely, if D: Sec{E®^) — > Sec(T®^'i?) is a v^-- derivation of 
degree such that D{K) is linear for each K , then there is an algebroid structure A onr: E ^ M 
such that D = dj. 

It is easy to see that the tangent algebroid lifts of a function on the base and of a 
section of E in local coordinates read 

dt(/(x)) = yVn^)^(^), 

(12) 

df (r(x)e,) = f\x)at{x)d.,a + (yV?(^)i£(^) + 4(^)?/V^(^)) dy,. 
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We will use the lifts of sections of E to vector fields on E in the sequel. Observe that for the 
section / : M — > E,the field df (/) is K-related to T/ : TM — > TE. 

The presence of the cotravariant tensor field IIa on E* allows in turn to associate with any 
C^-function h on E* the Hamiltonian vector field Xh defined in an obvious way: Xh = idhJ^li- 
In local coordinates, 

Xnix^i) = +P.^(x)£(x,e)a,.. (13) 

4 Homotopy of admissible paths on almost Lie algebroids. 

In order to motivate future definition of homotopy of E'-paths we shall sketch the procedure of 
reduction from a Lie groupoid to its Lie algebroid (compare [11 [23]). 

Consider a Lie groupoid G with the target and the source maps a, f3 : G — > M, and the 
identity section i : M ^ G. The groupoid G acts on itself by left multiplication. This action 
leaves j3 invariant and interchanges leaves of the foliation = {a~^{x) : x G M}, hence it 
induces an action on the distribution tangent to that foliation 

T"G := kerTa C TG. 

In the space of sections r(T"G) we may distinguish xl{G) - the class of fields invariant with 
respect to the action. Clearly xl{G) is closed with respect to the Lie bracket on G, hence forms 
a Lie algebra. Moreover, every element of xl{G) is uniquely determined by its value along the 
identity section i : M ^ G, thus we have an identification 

Xl{G) « T{E), where E = T"G|,(a^). 

The subbundle is a vector bundle with base M. Its space of sections r(£^) inherits the Lie 
bracket from xl{G). This bracket, together with p - the restriction of J (3 : TG — TM to E, 
gives a Lie algebroid structure on E. We have thus described the structure of a Lie algebroid 
associated with a Lie groupoid G. The situation we deal with is similar to the case of a Lie group. 
The left action of G allows us to identify T^G := T^GHT^G with via the map for every 
g £ G. Reduction is hence an isomorphism {g~^)* : T°G — > ^P{g)- 

Let g{t) be a curve which lies in a single leaf N of the foliation G". Denote x{t) = [5{g{t)). 
The reduction procedure applied to g{t) gives rise to a path a{t) in E covering x{t) 

a{t)=g-\t),g{t)- 

Observe that the path a satisfies the admissibility condition: p{a{t)) = x{t). Note also that, 
since g was of class G^, the path a is in general only continuous (of class C^). 

Consider now a homotopy (that is a one-parameter family) ge{t) of curves in N. Assume 
that g{t,£) := geit) is of class G^ with respect to both variables, and denote x{t,e) = j3{g{t,e)). 
Clearly, the reduction procedure described above leads to a one-parameter family of -E-paths 
t I— > a{t,e) covering x{t,e). On the other hand, the reduction with respect to parameter e 
produces another one-parameter family of i?-paths over x(t,e), 

d 

e ^ b{t,e) = g~'^{t,e)^—g{t,e). 

Clearly, a has an interpretation of the reduction of the homotopy g to E, and 6 is a reduction 
of the infinitesimal homotopy of g to E. Our goal now will be to describe the relation between 
a and b. For, we will use local coordinate charts. 
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Let (y*) be local coordinates on N and (x") on M. The adapted coordinates on TA^ and TM 
are (y', y^) and {x"", x^) respectively. Let (ei, . . . , em) be a basis of local sections on E. We have 
induced coordinate system (x'^,^*) on E. Denote by pf{x), c*^(x) the coefficients of the anchor 
and the bracket in this coordinates, p{ei) = pf{x)dxa, [ej,ek] = c'ji^{x)ei. The reduction map 
{9'^)* '■ TgA^ — > ^Pia) establishes the relation between coordinates in TA^ and E 



Denote by yfjiy)j the inverse matrix of Clearly, if = z"'{y), then pf{x) = -^z^{y) 

and 

Let now y^{t,e) be a homotopy in N. In local coordinates a and b read 

a\t,E)=Fi{y)dty', 
h\t,e)=Fi{y)deyK 

Assume for a moment that y^{t,e) is of class with respect to both variables. Thus, 
dtb' - dea' = (Fi{y)dtdey' + ^Fi{y)dty^dey') - {Fi{y)dedty' + ^Fi{y)dey^dty' 
^ :Fi{y)-^Fl,{y))dty^dJ = 



-^Fiiy) - ^F^{y))f^{y)f^{y)[Fi{y)d,y^) = c],{xWa^ 

In consequence, we know that when the homotopy in G is of class C^, then a and b are related 
by the differential equation 

dtU = dea' + c]k{x)V al" . (14) 

In general, when y^{t,£) is only of class C^, the functions o* and 6* are only continuous and 
equation ST4\i makes no sense. It turns out, however, that b^{t,e) = Fl{y)dey^ is the unique con- 
tinuous function being the weak solution of with initial condition 6*(0,e) = Fl{y)dey\0,e). 
That is 

^ -dt(t)tb'dtde = -dsM' + ^i^kixWa^dtde, (15) 

for every family of functions (pi : — > M of class Cq{I'^). 

Indeed, after short calculations one can see that the above condition is equivalent to 

/ ^ey'^t{(|)^Fi{y))dtde= [ aVa,(0,F/(y))dtde. (16) 
Since y\t,£) is a true homotopy in A^ we have 

dey^dti^idtde= I dty^dsMtde, 
P Jp 

for every family of function ipi G C^{l'^). Every function of class Co(/^) can be approximated 
in norm by functions from Cq°, hence the above equation holds true also for il^l = 4>iFi{y)- 
We have proved that b satisfies ([TS]) . The uniqueness of this weak solution will be proved later 
in this section in a more general setting. □ 
The above considerations motivate the definition of the homotopy on a general algebroid E. 
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Definition 4.1. The pair of continuous maps (a, b) : [to, ti] x [0, 1] — > Ex E, covering the same 
C^-map X : [to>ii] x [0, 1] — > M, will be called E-homotopy if 

1. For every t and e we have cj(a(t, e)) = dtx{t,e) and p(b{t,£)^ = d£x(t,e) (that is a is the 
family of i-admissible paths (with respect to the anchor a) and b the family of e-admissible 
paths (with respect to pj); 

2. Let a = {x"',a^) and b = (x",6*) in local coordinates on E. Then 6* is a weak solution of 
the differential equation 



dth' = dea' + c)k{x)b'a'', (17) 



that is 



^ -dt(pib'dtd£ = -de(t)ia' + 4>ic]k{x)h>a!'dtde, (18) 

for every family of functions (j)i : P — > R of class Cq{P). 

The map b : [toi^i] x [0,1] — > E will be called infinitesimal E-homotopy and the -B-paths 
b{to,£) and 6(ti,e) the initial and the ^na/ infinitesimal E-homotopies. We will say that (a, 6) 
is a E-homotopy with fixed end-points if the initial and the final infinitesimal S-homotopies are 
null paths. 

We shall now show that the above definition has an invariant geometric meaning. 

In the regular case, when a and b are of class C^, we may speak of tangent prolongations T^a € 
JE and Tth G JE. In local coordinates T^a = {x°-,a\deX^,d£a^) and Tj6 = {x°-,b\dtx'',dtV). 
In view of ([7]), the following can be directly checked. 

Theorem 4.2. For a and b of class , Equation (|17p together with a -admissibility of a and 
p- admissibility of b is equivalent to the geometric condition that vectors T^a and Ttb are related 
by K : TE — [>TE. Of course in this case equations (I17p and (fTSl) are equivalent. 

If a and b are of class only, there is no sense speaking of their tangent prolongations. The 
left- and right-hand side of the equation (fT8]) can be, however, described as follows. 

Consider an arbitrary C°-section 4> : P — > T*E over b : P — > E, with the property that 
T*r((/)) : — > E* - its projection to E* is a C^-section which vanishes on the boundary. In local 
coordinates (p = {,'x°'-,^^-,Pb-,4>j), where pi, is continuous and is of class Cq(/^). The e-tangent 
prolongation T,(T*t(V)) = (x", 5,0,) and A(0) = [x^ ,(t>^, p\{x)b\4j{x)V(l)k+Pb<y]{x)) 

are two elements in JE* over the same base point in E* , which project to the same vector 
{x^^dex^) = {x" , p\{x)b^) in TM (we use e-admissibility of b with respect to p). Consequently, 
their difference A(0) — T£(T*r(0)) = (^x°',(j)i,0,c^j{x)b'^(j)k — ds(t)j +Pb<7^(x)) is a vertical vector 
and it can be regarded as an element V (A((/)) — T£(T*r(0))) of E* . Evaluating this element on 
a & E gives 

{V (A(0) - T,(rr((/.))) ,a>^ = A^/a^ - de<P,a^ + pha'^{x)aK 

On the other hand, we can pair elements Kricp) = {x" , (pi, -pb,V) € T*E* and -Tt(T*r(V')) = 
(pi, -dt(pj) G TE*. The result is 

{nr{(P),-Tt{j*T{(P)))^^^ = -dt(P,lP +p0tx\ 

Note that Phdtx^ = Pb(Tj{x)a^ , since a is t-admissible with respect to a. Thus we get the following. 
Theorem 4.3. The equation in local coordinates ([TS]) is equivalent to 



{nri^),-Tt{T*T{(P))) dtde= / {V{A{(P)-T,{T*T{(P))),a)^dtde, 



for every section (p : — > T*E from the considered class. It has therefore unambiguous geo- 
metric meaning independent on the choice of local coordinates. 
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In control theory curves which are continuous and piecewise appear in a natural way. 
Every such a curve can be regarded as a composition of several curves. This motivates 
natural definitions of compositions of -E-paths and E'-homotopies. 

Definition 4.4. Let a : [to,ti] — > E and a : [ioi^i] — ^ E be two £^-paths (with respect to a or 
p) over X and x respectively. Assume that x{ti) = x(to). We define the composition of E -paths: 



{a o a){t) 




for t G [to,ti] 
ti + to) for t G -to + ill- 



Observe that the path a o a is in general piecewise continuous, while its base path x o x is 
continuous and piecewise C^. Prom now on, by an E-path we will understand a composition of 
finite number of £'-paths in the above sense. 

Definition 4.5. Let {a,b) : [to,ti] x [0,1] — > E"^ and (o, 6) : [io,ti] x [0,1] — > E^ be two 
£^-homotopies over x and x respectively. Assume that the final infinitesimal £'-homotopy for 
(a, 6) is equal to the initial infinitesimal i?-homotopy for (a, 6) that is b{ti,e) = b{io,e) for every 
e (in particular x(ti,e) = x(to,e), hence a and a are composable). We define the composition of 
E-homotopies (a, h) o (a, b) = {ao a, b), where 



for t £ [to,ti] 
ti+to) for t G [ti,ti -to +ii]- 



Naturally, b{tQ,e) = b{tQ,e) will be called the initial and b{ti — to + ^i;^) = b(ti,e) the final 
infinitesimal E-homotopy for aoa. 

Again we will extend our understanding of the term i^-homotopy to the composition of finitely 
many £^-homotopies in the former sense. 

Definition 4.6. We will say that two £^-paths (with respect to a) ao,ai : [to,ti] — > E are 
equivalent (and write oo ~ ai), if there exists an £J-homotopy with fixed end-points (a, 6) : 
[to,ti] X [0,1] — > E"^ such that ao(t) = a(t, 0) and ai{t) = a(t, 1). Relation ~ is clearly 
equivalence relation in the space of -B-paths with respect to a. Its classes will be denoted by 
[a] or [a(t)]te[to,ii] ■ Clearly, if ao and ao are composable and they are equivalent to ai and ai 
respectively, then ai and ai are also composable and [ao ° oo] = [^i ° oi]. 

Remark 4.7. So far we have no tool to compare two S-paths parameterized by two different 
time intervals. This can be done by extending the equivalence relation ~. We will add a 
(natural) condition that the composition with a null curve does not change the equivalence class: 
[aoO] = [a]. 

Now we shall discuss some basic, but important, properties of i?-homotopies. By the way 
we will see under which additional assumptions made on the structure of an algebroid E the 
£J-homotopies behave well. This will lead to the concept of AL algebroid. 

Lemma 4.8 (Generating £'-homotopies) . Let E he an algebroid. Take a one-parameter family 
of E -paths (with respect to a) a : [to,ti] x [0,1] — > E, covering x : [to,ti] x [0,1] — > M. We 
will assume that a{t, e) is piecewise continuous with respect to t and of class with respect to e 
and that x(t, e) is continuous and piecewise with respect to t and of class with respect to 
e. Let bo{e) be an arbitrary continuous E-path with respect to p covering x{tQ,e). 

There exists an unique E-homotopy {a,b) such that 6o(e) is its initial infinitesimal E- 
homotopy (for every choice of a) if and only if E has an unique anchor p = a which is an 
algebroid morphism (i.e. p{[X,Y]e) = [p{X), p{Y)]jm)- 
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Proof. By definition, the infinitesimal ii^-homotopy b{t, e) if exists should be the solution of the 
differential equation, which in local coordinates reads 

r dtb\t, e) = dea\t, e) + c]k[x{t, e)W (t, e)a\t, e). 

Since dsa{t, e) is well defined, there is no need speaking of the weak solutions. The above equation 
is an ordinary affine differential equation with respect to t with a parameter e. The general theory 
of ODE's guarantees that it has the unique solution b{t, e) continuous with respect to e. To prove 
that (a, b) is indeed an ii^-homotopy it is enough to show that e i—f b{t, e) is p-admissible for every 
fixed t. 

Consider a function 

X'^it, e) := dsx'^it, e) - p'^{x{t, e)) b'it, e). 

We shall show that = 0. 

Observe that since a(t, e) is the family of u-admissible paths 

dtx''{t,e) =al{x{t,e))al'{t,e). (20) 

The right-hand side of this equation is differentiable with respect to e, hence so is the left-hand 
side and 

da"" 

dedtx'^it, e) = dtdex^t, e) = -Q^ {x{t, e)) dex\t, e)a'' {t, e) + at {x{t, e)) d^a^t, e). 
Consequently, 



dtx" = dtdex" - dt[plb^j = -^dex^a" + atdea" - -^dtx%' - p'^dtb' = from ^ and ^ 



dx^ dx^ 
d 



\dx^ 



We have an affine differential equation for Xa with initial condition x"'{to,e) = (since bo{£) 
is /O-admissible). The solution is constantly if and only if the last two terms in the above 
equation vanish. To guarantee it regardless of a{t, e) we have to assume that = (the 
anchor is unique) and it is an algebroid morphism 

( ^ ^Anb ( ^ Ar.b ^aj 

□ 

It turns out that when an algebroid has an unique anchor being an algebroid morphism, 
the -E-homotopies are true homotopies in the space of i?-paths (i.e. one-parameter families of 
i?-paths). This has been already observed in [121 Theorem 3] in a slightly different form. From 
now on we will speak only of algebroids satisfying this conditions (hence we can forget about 
distinguishing admissibility with respect to p and a). 

The next lemma states that shrinking an E'-path to its initial (or final) point is an E'-homotopy 
provided that E is AL algebroid. 
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Lemma 4.9 (Shrinking a curve). Let a : [0,1] — > E be an E-path. Define a{t,e) = ea{te), 
b{t,e) = ta{te). The pair (a, 6) is an E-homotopy (for every choice of a) if and only if E has a 
skew anchor. The initial infinitesimal E-homotopy is equal to and final to a. 

Similarly, consider d{t, e) = (1 — e)a(l — (1 — t){l — e)), b{t, e) = {1 — t)a{l — {1 — t){l — e)). 
The pair (a, b) is again an E-homotopy whose initial infinitesimal E-homotopy is equal to a and 
final to 0. 

Proof. . First of all check that t ^ ea{t£) and e i— >• ta{te) are -E-paths. Since x{t) = p[a{t)^, 
clearly dt[x{et)) = ex{te) = ep[a(te)) = p[£a{te)). The same calculation holds for b{t,e). 
Denote by the integral of a*(s). For every € C^{l'^) we have 

/ de(pi£a\te)dtde = [ de(l)idtA\te)dtde = 
Jp Jp 

dtde(^iA'{te)dtde + J^(^deUhe)A\e) - deUO,£)A\0))d£ = 
dedt(l)iA'{te)dtde + / (0 - 0)de = / dt(l)ita'{te)dtd£. 



P 



Since every function in Cq(I^) can be approximated in norm by C^{l'^)^ we have for every 

/ de(l)i£a\te)dtde = / dt(t)ita\te)dtde . 
Jp Jp 

We see that the pair (a, b) satisfies the weak equation 

dtb' = dea' 

The latter equals Sga* + d-JPa^ = dsCL^ + ted-^^a^ {te)a^ {te) (hence is £'-homotopy) regardless of 
a if and only iff the last term vanishes, hence the bracket is skew-symmetric. 

The conclusion for (a, b) is proven analogously. □ 



We see that i?-homotopies satisfy the natural geometric properties discussed in lemmas 
and 14.91 if the bracket is skew-symmetric (what implies unique anchor p = a) and the anchor 
is an algebroid morphism. This is what we defined under the name almost Lie algebroid (AL 
algehroid). From now on we will assume that E is an AL algebroid. 

The next result is a simple, but important consequence of lemma l49l 

Lemma 4.10. Let {a,b) : [to)*i] x [0, 1] — * E"^ he an E-homotopy. Then, 

[a(_,0)o6(ti,_)] = [6(to,_)oa(_,l)]. 

Proof. The first part of the lemma applied to the curve e i-^ 6(to, e), gives us the existence 
of £;-homotopy (c, d) : [0, 1] x [0, 1] — > E^ such that c{t, 0) = 0, c{t, 1) = b{to,t), d{0, e) = and 
d{l,e) = b(to,e). 

Similarly, using second part of lemma 14.91 for e i— > b{ti,e), we obtain an £'-homotopy (e,/) : 
[0,1] X [0,1] — > £"2 such that e{t,0) = b{ti,t), e(t, 1) = 0, /(0,e) = b{ti,e), /(l,e) = 0. 

Clearly, £'-homotopies (c, d), (a, b) and (e, /) are composable and their composition is the E- 
homotopy with fixed end-points, which establishes the equivalence of £^-paths Qoa{_,0)ob{ti, _) 
and 6(to, _) o a(_, 1) o 0. □ 

Remark 4.11. The above lemma will be very useful, as it shows the connection between E- 
homotopies with and without fixed end-points. Consider £^-homotopy {a,b) : [to,ti] x [0,1] — > 
E"^ . If the initial infinitesimal £'-homotopy b{tQ,£) is a null curve, in order to check that 
[a(_,0)] = [a(_, 1)] it is enough to check that \b{ti, _)] = 0. Thus the problem of equivalence of 
a(_,0) and a(_, 1) can be solved by investigating the final infinitesimal £'-homotopy. 
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Next we shall show that every E-path can be considered as a path parameterized by the 
interval [0, 1]. 

Lemma 4.12 (Reparameterization). Let a : [to,ti] — > E be an E-path and define a{t) := 
{ti — to)ffl(io + (^1 ~ tQ)t) for t G [0, 1]. The classes [a] and [a] are equal. 

Proof. Consider a{t, e) = ea(to + {t — to)^) and b{t, e) = {t — to)a(to + {t — to)e). Analogously 
to the proof of lemma [13] one easily verifies that (a, b) : [to,ti] x [0, 1] — > E"^ is an ^^-homotopy. 
The initial infinitesimal i5^-homotopy h{tQ,£) is a null curve and the final is 6(ii,e) = a{e). It 
follows from lemma [4. 101 that: 

[Ooa] = [a(_,0)o6(ti,_)] = [6(^0, _) o a(_, 1)] = [Ooa]. 

□ 

At the end of this section we will give results concerning existence and uniqueness of E- 
homotopies. 

Lemma 4.13 (Uniqueness of i?-homotopies). For every continuous family of t-admissible paths 
a{t,e) over x{t,e) and for every E-path bo{e) over x{to,e), there exist at most one continuous 
family of e- admissible paths b{t,e), such that {a,b) is an E-homotopy and 6o(£) is its initial 
infinitesimal E-homotopy (i.e. 6o(e) = b{to,e)). 

Proof. Let 6* and 6* be two continuous functions being two weak solutions of (fTSl) with the 
same initial condition. The difference 6b^ := V — U satisfies 

- 6b'dt4>idtde = cii,5b> a^Mtde, 
for every (pi E Cq{P). We see that Sb^ is a weak solution of the linear differential equation 

r dtf = c],a''f^, 
\r(0,e)=0. 

Clearly /* = is another solution of this equation. General theory of linear ODE's gives us the 
uniqueness of this solution (precise argument can be given by Dubois-Reymond Lemma), hence 
6b' = □ 



5 Control systems on AL algebroids. 

A classical control system is a differential equation on a manifold M dependent on a control 
parameter u which takes values in some topological space U. This can be realized by a continuous 
map f : M X U — > TM, such that f{-,u) is a section of TM for each u £ U. Our motivation 
to introduce control system on an almost Lie algebroid comes, of course, from the reduction 
procedure. Clearly, if / : G x [/ — > T"G C TG is a control system on a Lie groupoid G, 
equivariant with respect to the left action of G on G and T"G, it reduces to a continuous map 
f : M X U — > E taking values in - the Lie algebroid of left invariant vector fields of G. In 
this situation f{-,u) is a section of the bundle E. This motivates the following definition. 

Definition 5.1. A control system on an almost Lie algebroid E is a continuous map 

f : M xU — > E. (21) 

We will assume that U is a Haussdorff topological space and that /„ := f{-,u) is a G^-section of 
E for each u U. 
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Fixing a function u : [toi^i] — U (here [to,ii] is an arbitrary interval) and initial point xq, 
one will obtain a differential equation on M 



x{t) = p{f{x{t),u 

x{to) = Xq. 



it)), 



(22) 



We will consider only functions u which are piecewise continuous (that is, u has finitely many 
points of discontinuity and posses one-sided limits at every such point). Such u's will be called 
admissible controls. 

Basic properties of ODEs guarantee that for every admissible control u there exists (at least 
locally) x{t) - the unique solution of the differential equation ((22]) which is continuous and 
piecewise C^. Note that if x{t) is the solution of ([22]) . then a{t) = f{x{t),u{t)) is an E-path 
over x{t). This E-path will be called the trajectory of the control system associated with the 
admissible control u{t). 

Another important concept in control theory is a cost function L : M x U — > M. We 
will assume the same regularity conditions as in case of the control function, namely that L is 
a continuous function which is of class with respect to the first variable. If now x{t) is a 
solution of the system ([22]) for some admissible control u : [toi^i] — > U, we define the total cost 
of this solution to be 



(Note that since L is continuous, u{t) piecewise continuous and the interval [toi^i] compact, the 
above integral is finite whenever the solution x{t) exists). 

Our next goal is to formulate the optimal control problem for a system (f2T]) with the cost 
function L. Clearly, we should minimize the total cost integral f^^ L{x{t),u{t))dt for some class 
of solutions of the system ([2T]) . In classical control theory (with E = TM) one often considers 
the problem of finding a curve x{t) joining two fixed points xq and xi on a manifold M . It 
is not completely clear how should we substitute the fixed-end-points condition when working 
on an algebroid E. In order to motivate the definition one should again look at the reduction 
procedure. We start from a G-equivariant control system on Lie groupoid G and consider only 
solutions joining two fixed points go and gi (note that they both should lie in a single leaf of 
a foliation G°). If N is simply-connected, the homotopy classes of curves in are determined 
by the end-points. As we already know, C^-homotopies on G reduce to E'-homotopies. Hence, 
in a optimal control problem on an AL algebroid one should compare the equivalence classes of 
trajectories. 

Definition 5.2. Consider a control system (f^ on E with cost function L. Fix an equivalence 
class [a] of E'-path a with initial base-point xq- We will understand an optimal control problem 
on E as follows. Find an admissible control u : [tc^i] — > U (the interval / = [toi^i] is to be 
found as well) such that: 

(a) the admissible path f{x{t),u{t)) in E induced by u{t) belongs to the homotopy class [a]; 

(b) the total cost f^^^ L{x{t),u{t))dt is minimal among admissible controls satisfying (a). 

(Here x{t) is the solution of the equation ([22]) with the initial condition x(to) = xq). 

Before we proceed to the formulation of a generalization of the Maximum Principle, we will 
consider two important aspects of control systems on Lie algebroids. The first one is passing to 
the product algebroid TM x E which will allow us to treat both the control and the cost functions 
in the same manner. The second is the possibility of generating E'-homotopies with a help of the 




to 
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control system. 

Denote by A the product algebroid TM x E over M x M (TM is a tangent bundle of the real 
line with the standard Lie algebroid structure). The canonical projections pE '■ A — > E and 
PR : A — > TM are algebroid morphisms and they map admissible paths into admissible ones. 
We will consequently, to the end of this paper, use bold letters to emphasize objects associated 
with A, for instance: x = x) G R x M and a = (a°, a) £ TM x E. 

Fix an admissible control u : [ioj^i] — ^ U. We may consider the differential equation 

('x°(t) = L(x(t),n(t)), 
\ xit)=p{fixit),uit)), 

with the initial conditions x^{to) = and x(io) = xq. Clearly, the above equation can be 
considered as the differential equation associated with a control system on the algebroid A 

f = (/O, 7) : (M X M) X [/ — >TRx E = A, (24) 

where f^{x'^,x,u) = {x^,L{x,u)) G M x M = TM and f{x^,x,u) = f{x,u). (Observe that the 
dependence of f on xq is trivial). Note that x^{ti) = f^^ (x(t), u(t))dt, hence the system ([Ml) 
contains the information on both: the system (f2T]l on E and the cost function L. 



Remark 5.3. We can now reformulate the optimal control problem on E in terms of ([Ml) as 
follows. Find an admissible control u : I = [to,ti] — > U such that: 

(a) the admissible path f(x(t),u(t)) in A induced by u{t) projects to the homotopy class [a] in 

E; 

(b) the total cost x^{ti) is minimal among admissible controls satisfying (a). 

(Here x(t) = [x'^{t),x{t)) is the solution of the equation ([23]) with the initial condition x(to) = 
(0,xo)). 

As has been observed in [9] £J-homotopy can be generated by a time-dependent section on E. 
Since the control system ([22]) is a family of -E-sections fu, fixing admissible control u{t) produces 
a time-dependent family of sections . The associated £^-homotopy is well understood in terms 
of lemma l4.8l Indeed, solving equation ([22l) for a one-parameter family of initial conditions xo{e) 
(denote such solution by x(t,e)) one obtains a one-parameter family of £^-paths 

a{t,£) ■= f{x{t,e),u{t)). 

It is a student ODE's-theory exercise to show that if the solution x{t) is defined for t G [to)*i]i 
so are the solutions x(t,e) (at least for xo(e)'s close enough to xq). Moreover, the dependence on 
the initial condition is smooth. Lemma HiH] guarantees that, given a continuous E'-path bo{e) over 
x{tQ,e), there exists a map b{t,e) such that {a,b) is the E'-homotopy with initial infinitesimal 
E-homotopy bo{e). In local coordinates on E b{t,e) = {x"'{t,e),b^{t,e)) is the solution of the 
differential equation 

, 9t6^(t,e) = ^(x(t,e),n(t))p^(x(t,e))6'=(t,e) + 4,(x(t,e))fr^(t,e)/'=(x(t,e),u(t)), ^^5) 
^dtx''it,e) = pt{x{t,e))r{x{t,e),u{t)), 

with initial conditions b^{to,£) = ^o(^) ^^'^ x"'{to,e) = XQ{e). The t-evolution of b{t,e) can be 
described in terms of tools introduced in section [3l For every u £ U we may lift the section /„ of 
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E to the linear vector field dj(/„) on E. Evaluating it on u{t) gives the time-dependent family 
of vector fields dj (/^(t)) on E. In local coordinates on TE 

df (x, y) = (x^ y\p';{x)f{x, n(t)), |^(x, u{t))pUx)y' + 4,{x)y^f\x, u{t))) . 

Clearly, equation ([251) describes the evolution along this field. 

On the other side of the picture, with the family of section we may associate a family 
of linear functions ht{£,) '■= {f{'^{C)jU{t)),^'j^ on E* . It defines the family of Hamiltonian vector 
fields Ai'/ij on E*. In local coordinates on TE* 

XhA^^O = {^''.iuP]{^)f\xMt)),c%{x)f\x,u{mu- P'',{x^ 

We have thus introduced two time-dependent vector fields (^j{fu{t)) on E and Xht on E* . Note 
that both fields give the same base evolution which is precisely defined by equation (f22]) . 

Definition 5.4. The flows of the above fields will be called operators of parallel transport along 
the solution x{t) of the system (f2T]) . We will denote them by Bts and Bts respectively. The 
analogous operators associated with the control system ([241) will be denoted by B^^ and B^^. 

Lemma 5.5. Operators B and B have the property of preserving the paring (•, •),-, that is 

{Bu,iy),BuoiO)r = {y^^)r^ 
for every y & E and £ E* over the same base point in M . 

Proof. Since B and B are the flows of fields dj(/„(f)) and X^^ it is enough to show that 

(df(/„(i)),A',,>^^ = 0. 

This, in turn, can be seen by explicit coordinate calculation. The skew symmetry of c*^(x) is 
used. □ 
At the end of this section observe that the Hamiltonian evolution on A* = T*Rx£^* associated 
with the control system ([24l) is trivial on the T*M-component. Indeed, it is straightforward to 
verify that z(t) = [zQ{t) z{t)) = Bft(j(z(to)) evolves due to equations 

dtZkit) = -/5^(x(t))(^(x(t),n(t))z,(t) + — (x(t),n(t))zo) +4fc(x(t))/J(x(0,n(t))2i(t^ 
dtzoit) = 0. 

(26) 

6 The Maximum Principle. 

Recall first what we understand by an optimal control problem on an AL-algebroid. 

We consider the control system f : M xU — > E with the cost function L : M x U — > M on 
an AL-algebroid E. We look for an admissible control u : [to,ti] — > U (the interval [toj^i] is not 
fixed), such that the associated trajectory /3(/(x(t), ti(t))) belongs to a fixed i?-homotopy class 
[a], and such that the total cost integral f^^ L(x(t), ii(t))dt is minimal among all such controls. 
Here x(t) is the solution of the differential equation x{t) = p[f{x{t),u{t))) with initial condition 
x(io) = xq - the initial base-point of a. 

Recall also that we have defined the map f = (f^J) : [Rx M) xU — ^ TM x =: A. Here 
/°(x°,x,ii) = (x°,L(x,u)) G M X M = TM and 7(x°,x,n) = f{x,u). 
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Theorem 6.1. Let u : [to,ti] — > U be a solution of the optimal control problem. There exists 
a curve z{t) = {zo{t), z{t)) : [tQ,ti] — > A* (with initial base-point xq = {0,xq) and such that 
zo{ti) < 0) which satisfies the following conditions: 

• the curve z(t) is a trajectory of the time- dependent family of Hamiltonian vector fields 
associated with the Hamiltonians Ht(z) = H(z,?i(t)), where 

H(z,u) = (f (7r(z),u) ,z)^ ; 

• the pair u{t) and z(t) satisfies the "Maximum Principle" 

H(z(t),M(t)) = supH(z(t),?;) 

veu 

at every point of continuity of the control u; 

• the covector z{t) is nowhere-vanishing; 

• H(z(i), u{t)) = at every point of continuity of the control u. 

The above theorem is stated in terms of the algebroid A - which will be useful in the proof. 
It is equivalent to Theorem 11.11 stated in terms of the algebroid E. The equivalence of theorems 
16.11 and 11.11 is clear. Since, the Hamiltonian evolution of T*]R-component in A* is trivial, the 
curve z{t) from theorem 1 6 . 1 1 equals (zq, z{t)). The Hamiltonian evolution of z(t) in A* associated 
with Hf project to the Hamiltonian evolution of z(t) in E* associated with Ht- □ 

Proof. Starting from a solution of the optimal control problem (x(t),M(t)), we will consider 
variations of the trajectory a(t) = f (x(t), in the form 

a,(t) = f(xe(i),u,(t)), 

where Ue{t) is a variation of the control. The problem is that at the same time we must fix the 
homotopy class [a£(t)] . We will therefore consider a,, as an A-homotopy with some infinitesimal 
A-homotopy h{t,e). Due to lemma B.lOl in order to compare equivalence classes of a^, it is 
enough to study b(t, e). Of special interest will be the element b(t,0) € Ax(t) and, more gener- 
ally, the set Kf C Ax(f) of all such elements obtained for different variations u^. The optimality 
of u will impose special geometrical conditions on Kj, namely that Kt is a convex and proper 
subset of Ax(t). Consequently, there exists a covector z{t) G ^J^{t) supporting Kj. A similar 
strategy was used in [30] in the classical situation E = TM. 

We will start with introducing an 'idle' variation of a fixed admissible control u : [io, ti] — > U . 
Usually one understands a variation as a continuous deformation. In case of an admissible control, 
however, we must change this picture. Imagine, for instance, that i7 is a discrete set and u is 
constant on [toj^i]- There is obviously no way of deforming ti by a continuous deformation. Our 
goal is, however, not only to deform u, but to construct a corresponding family of trajectories 
of our control system. We expect that a small change of control will lead to a small change of 
the trajectory of the system. We will define a variation of the control w as a substitution of u 
by some value G C/ on a small interval of length eSti. We will also allow another operation 
on the control, namely, lengthening or shortening the time interval on which u is defined by a 
number e5t. This is the idea standing behind the concept of the variation of the control. Here 
is a formal and rather technical definition. 

Let u : [to,ti] — > U he a fixed admissible control. Choose points to < ti < T2 < . . . < 
Ts < T < ti, which are the points of continuity of u. Next, choose non-negative numbers 
5ti, . . . ,6ts and an arbitrary real number 6t. Finally, choose (not necessarily different) elements 
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vi,...,Vs G U. This whole set of data {Ti,Vi,T, 6ti, 5t)i=i^,,,^s will be denoted by tt), and called 
the symbol of the variation. 

Next, we define half-open e-dependent intervals li for i = 1, s. Take 

6t — {5ti + . . . + 6ts) when Tj = r; 

- {6ti + . . . + 6ts) when = < r; 

- {6ti + . . . + dtj) when Tj = Tj+i = . . . = r,- < Tj+i, 

and denote Ij = (rj + eli,Ti + + As we see, the interval li is open from the left and 

closed from the right and it has length e ■ 6ti. If Tj < Tj+i or i = s and Tg < t the end-point of 
li lies at Tj. If Ti = Tj+i, the end point of Jj is at the beginning point of /j+i. If Tg = r, we set 
the end point of I<j at r + edt. Clearly, for e small enough intervals Ij lie inside [toi^i] and they 
are pairwise disconnected. 

Definition 6.2. For t E [to,T + edt] we define a new admissible control: 

u^t) = b ' ^ (27) 

\u{t) whentG [tcr + e^tl-Ui/i- 
This one-parameter family of controls uf will be called a variation of the control u associated 
with the symbol to. 



Remark 6.3. Observe that, when Jtj = 0, the interval li is empty. Consequently, we can add 
points Ti with arbitrary Vi and Tj = to the symbol to without changing the variation n" 



Fix a symbol to = (xi, fj, r, (5t)i=i,...,s and an admissible control u. Let be a number such 
that is well defined for e < 6* (i.e. the intervals Ij are pairwise disconnected). We consider a 
family of trajectories of the control system ([2^ obtained for different admissible controls 



a(t,e) = f(x(i,e),nf(t)), 
where x(t, e) is the solution of the differential equation 



x(t,e) =PA(f(x(t,e),n«(t)) 
x(to,e) = xo(e), 



(28) 



with xo(e) being an arbitrary C^-path in M x M . We will denote the unvariated trajectories by 
a(t) := a(t,0) and x(i) := x(t,0). 

Lemma 6.4. Let c(e) 6e any continuous A-path covering xo(e). There exists A-homotopy 
(a(t, e), b(t, e)), for t € [ioi^i] o-nd e G [0,^], such that its initial infinitesimal A-homotopy is 
c{e), and for every e < 6 we have the equivalence [a{t, e)t^[tQ^T-j^^st]\ = [^(^i ^)te[to,fL]] • Moreover, 
the final infinitesimal homotopy h{ti,s) =: d™(s) satisfies 

[c(s)s6[o,£]] [ait,e)te[to,T+e5t]] = [a(i)te[to,r]] [d"'(s)se[o,£]] , (29) 

and 

s 

d"(0) =f(x(T),u(T))5t + B,t„(c(0))+ J];B,,^[f(x(Ti),t;i)-f(x(Tj),u(r,))]5t, G A,(,). (30) 

i=l 
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The proof is rather long and we postpone it to section 17.11 
Motivated by the above result we define 



:= cl{{ (x{T),u{T))5t+'^Brr, f (x(Ti) , Uj) -f (x(ri) , -(/(t,)) 5ti : {Ti,Vi,T,6ti,6t)i=i^,,,^s is a symbo 

i=l 

The set K" can be understood as the set of all directions in Ax(t-) in which one can move the 
point x(r) by performing variations of control of the form without changing xq - the initial 
base point of the trajectory. The geometry of K" will be the object of our interests. 

Lemma 6.5. The set K,- is a convex cone in Ax(t-) (with vertex at 0). 

Proof. Take numbers >Q and symbols to = (tj, fj, r, (5tj, (5t)j=i^...^s and 
tr = (Tj , Uj, r, 5t^,6t ^' . We have to find a symbol d such that 

d''(0) =i/d"(0) + z^'d"'(0). 

Due to the remark [Ql we may change a symbol by adding {Ti,Vi,6ti = 0) without changing 
the variation uf. As we see from the form of ([^ . such an addition will not change d"^(0). 
Consequently, we may assume that s = s , Ti = t^, Vi = and symbols to and tt) differ only by 
5ti and 6t. Now, consider a symbol d = (tj, f «, r, udti + v 6t^, uSt + 1/6 )i=i,...,s. The formula ([30]) 
(for c(0) = 0) is linear with respect to 6ti and 6t, hence 

d°(0) = i/d"'(0) + i/'d"'(0). 

□ 

Take a point x = (xq, G M x M and denote Ax = M_ x {0} c T^-qIR x = Ax- 

Lemma 6.6. Let x(t) and u{t), for t E [io,ti], be a solution of the optimal control problem. 
Then, the ray Ax(r) cannot lie in the interior 0/ K,-, for any r € (to 7*1) which is a point of 
continuity of u. 

Again, we postpone the proof until section 17.21 

Corollary 6.7. Forx and u as above, Kt- is a proper convex subset o/Ax(t-), hence there exists 
a covector z € A*^^^ such that, for any d G K.^, 

(d,z>^<0. (31) 

Lemmata 16.41 and 16.61 contain the essential geometrical information about the optimal trajec- 
tories. The curve of covectors, existence of which is states in the Maximum Principle, are just 
covectors supporting convex sets Kx(t) for t £ [tQ,ti]. In order to finish the proof one has to 
perform several rather technical, yet not very difficult steps. These are exactly the same as in 
the original Pontryagin's result (see [30l section 2.15]). 

Prom now on we will assume that u{t) (for t G [to)*i]) is a solution of the optimal control 
problem and x(t) is the associated base trajectory. Fix r G {tQ,ti) being the point of continuity 
of u, and z G A*^^^ as in the above corollary. For t G [to, t] let us define z(t) = B(t-(z). 

Lemma 6.8. For every t G [to,T] - a point of continuity of the control u{t), the following 
"Maximum Principle" holds 

H(z(t),M(t)) = supH(z(t),u), 
and, moreover, H(z(r),u(r)) = 0. 
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Proof. Consider a symbol tr = (ri = t, 6ti > 0,vi = v, r, 5t = 0) (here v is an arbitrary 
element of U). With ro we can associate an element d"'(0) = B^-t [f (x(t), — f (x(t), M(t))](5ti G 
K^f. From ^ we obtain 



(f (x(t), - f (x(t), u(t)), Bt,(z)>^(^ti = ((f (x(t), v),z{t))^ - (f (x(t), n(t)), z(t)>^j 5ti 
Il{z{t),v)-U{z{t),u{t)))6h. 



Hence, for every v gU, ii{z{t),v) < H(z(i), u(t)). 

To prove the second part of the assertion take the element d = f (x(r), u{T))6t, which clearly 
belongs to K" {6t is an arbitrary real number). Consequently, from (f3T]) we obtain 

> (z,f(x(r),n(r))>/t = H(z(t), n(T))5t. 

Since 6t can be arbitrary, we deduce that H(z(t), ii(T)) =0. □ 
To finish the proof just two more things are left. We have to check that H(z(t),u(t)) is 
constantly 0, and somehow extend z(t) to the whole interval [toi^i] (so far it was defined on 
[to,T], where r < ti). We will start with 

Lemma 6.9. H(z(t),u(t)) = at every point of continuity t G [^O)''"] of the control u. 

Proof. Denote P = {u{t) : t G [to,''"]}- Since u{t) is piecewise continuous, P is a compact 
subset of U. Define a new function m : A* — > M by the formula 

m(z) = maxH(z,'i;). 

In view of the previous lemma, we can deduce that m(z(t)) = H(z(t),u(t)) at every point of 
continuity of u. We shall show that m(z(t)) is constant, hence equal to H(z(t),u(t)) = 0. 

The interval [to,T] is compact, so A|x(f) can be covered by finitely many local coordinate 
charts. Take one such chart covering the interval [to,t'i] C [to,''"]- We can write H(z(t),u) = 
Zj(t)f*(x(t), f ). Since Zj(t) (compare equation (f26l) ) as well as ^|s-f*(x, u) and x'^(t) are piecewise 
continuous and [to>*i] and P are compact, there exist a number A such that 

U{z{t),v) -U{z{t),v) <X\t-t\ 

for t,t G [to,t'i] and for any v G P. In consequence, 

-X\t-t\ < U{z{t),u{t)) -U{z{t),u{t)) < m{z{t)) -m(z(t')) = 

= H(z(t),u(t)) -H(z(t'),M(t')) < H(z(t),u(t)) -H(z(t'),u(t)) < X\t-t\ 

for any t,t G [to,t'i]- We deduce that m(z(t)) is Lipschitz function, hence it is almost everywhere 
differentiable (Rademacher's theorem). 

Now, take any point t of differentiability of m(z(t)) which is also a point of continuity of the 
control u{t). We have 

m(z(t')) - m(z(t)) > H(z(t'), n(t)) - H(z(t), n(t)). 

For t > t, we get 

m(z(t'))-m(z(t)) ^ H(z(t'),n(t))-H(z(t),n(t)) 
t' -t ~ t' -t 
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Consequently, 



d 



d 



^,^U{z{t),u{t)) = 0. 



(The last equality follows from straightforward coordinate calculations, compare lemma [53]) . 



Similarly, for t < t, we would get ^m(z(t)) < 0. We may deduce that ^m(z(t)) = almost 



everywhere in [to)''"]: hence m(z(t)) is constant. □ 
Lemma 6.10. Lett € [to,T] be any point of continuity of the control u(t). T/ien B^-t (K") C K". 
Proof. It is enough to show that every element from KJ* of the form 



d = f (x(t), n(t))5t + ^ Btr, [f (x(Ti), - f (x(ri), n(ri)) 
is mapped into by Brt- Clearly, 



1=1 



6ti 



i=l 



6t, 



^rn U{^in),Vi) - f (x(ri), uin))] 5ti G 



i=l 



In consequence (since is convex), it is enough to show that 

B,t(f(x(t),n(t))5t) GK^ 

Assume the contrary. Since K" is a closed convex set, there exists a hypersurface in Ax(t-) (which 
contains 0) separating K" from the element Bt-j ( f (x(t), ii(t))5t ) . In other words, there exist an 



element z € A*^^^ such that (B^-j (f (x(t), ii(t))(5t) , z)^ > and, at the same time (d,z)^ < 
for any d G K". 

Define z(t) = B(,-(z). Lemmas l6.8l and [0] hold for z(t) so. in particular, (x(t), u(t)), z(t)^ = 
H(z(t),u(t)) = 0. On the other hand, 

< {B^t{n^{t),u{t))6t),z)^ = {i{^{t),u{t)),z{t))jt, 

hence (f (x(t), w(t), z(t))^ / 0. □ 
Note that, so far, we could define the set K" only for t < ti. With the help of the above 
lemma we can also define K"^ as a direct limit of the family of sets Bj^t-(K") 

T<tl 

Since Bj^^ is a linear isomorphism, it is clear that K"^ defined in such a manner is a convex cone 
in Ax(t^) with vertex at 0. The set K"^ has geometric properties analogous to the properties of 
K!f described in lemma [621 



Lemma 6.11. For a solution of the optimal control problem u{t), with t G [toi^i], the ray Ax(t^) 
cannot lie in the interior of K"^ . 

Proof. Assume the contrary. If ^■x.(ti) lies in the interior of K"^, then there exist an element 
1 G Ax(ti) and a convex polytope P = convjli, . . . 1^} C KJ*^ which contains 1 as its internal 
point. Since K"^ is defined as a limit of a increasing sequence of sets, there exists t < ti such 
that all vertices li,...!^ lie in BtjT-(K"). Yet B^^t- is a linear isomorphism that maps Ax(t-) 
into Ax((j). Hence Bj~^(P) C K" is a convex polytope which contains a point form Ax(t-) as its 
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internal point. That contradicts lemma [6?6l 



□ 



Now we can finish the proof of the main theorem. From the previous lemma we can deduce 
that K"^ is a proper convex subset of -^x{ti) and that if ^x{ti) is a subset of K"^, then it lies 
on the boundary. Hence, there exist a covector z E -^x{ti) such that for every d € K"^ we have 
(d, z) < and at the same time (l, z) > 0, for every 1 € ^x(ti)- (The last inequality implies 
that zq - the TR-component of z, satisfies the condition zq <0). 

Denote z(t) = Bt(^(z). Take any point r G [to,ti) of continuity of the control u. Since 
Bt^^(K") C K"^, for every d G K" we have 

0>(Bt,,(d),z>^ = (d,z(T)>^. 

That is enough for lemmas EIE] and EUl to hold for z'(t) = BiT-(z(r)) = 'Btr^rtii'^) = Bt(^(z) = 
z{t). Hence, for every point of continuity of the control u, we have 

H(z(t),u(t)) =0, 

what finishes the proof of the Pontryagin Maximum Principle for almost Lie algebroids. □ 

7 Proofs of two important lemmata. 
7.1 Proof of lemma 16. 4L 

Recall that we deal with the family of A-pathes a(t, e) = {{x(t,e),uf{t)), where x(t,e) is the 
solution of the equation ((28]) . We fix a continuous A-path c(e) over xo(e). Denote by B^^ the 
operator of parallel transport in A associated with the unvariated control u(t). 

One may ask why it is necessary to substitute a(t, e) with a(t, e) in the assertion of the lemma? 
This will be done due to technical reasons: A-homotopies are defined for A-paths parameterized 
by a fixed time interval. In order to compare classes of paths parameterized by different intervals 
(as is in the case of a), we have to use tricks as reparameterization or composition with a null 
path. 

We will start with two lemmata. 

Sublemma 7.1. Fort £ [tQ,ti], let a(t, e) = f (x(t, e), u(t)) be a family of A-paths obtained 
/or x(to,e) = xo(e). Denote h{t,e) = Btfo(c(e)). The pair (a, b) is an A-homotopy. Hence, 
c(e) is its initial infinitesimal homotopy and its final infinitesimal homotopy at e = is equal to 
5tito(c(0)). 

Proof. This is just the definition of the operator ^tto - compare ([251) and definition 15.41 □ 

Sublemma 7.2. For t G [0,6t] take a(t,e) = ef(x(to + £t,e),u{tQ + et)) where x(t,e) is as in 
lemma FTTl Define h{t,e) = B(ig+£()(p (c(e)) + tf(x(to + £t,e),u{to + et)). The pair (a, b) is 
an A-homotopy. Its initial infinitesimal A-homotopy is equal to c(e) and its final infinitesimal 
homotopy at e = is h{5t, 0) = c(0) + f (x(to), u{to))6t. 

Proof. We have to check, if for every family of functions ifi G Cq ([0, 6t] x [0, 6]), 

- j dm {^{u,+et)t, (^(^)) + *f*(^(*o + e), ^^(^0 + ei))) dtde = 

- j de^iei\±{to + et,e),u{tQ + et))dtde + j ¥?iC*fcBjj^_^^^^^^(c(e))ef''(x(to + et,e),'u(to + et))dMe. 
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Now, performing the change of variables {t,e) i-^ (s = te,e) in above integrals we will end up 
with 

- j dsipiPixito + s,e),u{to + s))dsde + j ^/'i4fcB(to+s)to(c('^))f'^'(x(to + s,e),^i(io + s))dsde, 

where ipi{te, e) = (pi{t, e). This is just the condition for the pair (a, b) from the previous lemma to 
be an A-homotopy. What is more, since (9ex(to+s, e) = p{B[to+s)toi'^(.^))) ) using the admissibility 
of a we have 9ex(to+te, e) = p{B(^tf-,+te)to (^(s))) +tp[f{'x.{t+0+te)) , hence b{t, e) is e-admissible. 

□ 

Now, the proof will be inductive with respect to s - the number of elements in a symbol 

tr = iTi,Vi,T,6ti,6t)i=i^,„^s- 

1. First step. For s = we have tv = (r, 6t) and uf{t) = u(t), so that 

[a(i,e)te[to,T+e<5t]] = e)tg[to,r]] e)te[r,r+e<5t]] = 

= [f(x(t,e),u(i))tg[t^^^]] [f(x(t,e),u(i))tg[^_^+£5t]] = 

= [f e),u{t))te[tQ,r]] [ef (x(t + te, e),u{T + et))te[o,5t]] 

(here we used lemma 1^.121 to reparameterize the second term). 

It follows from lemma [Tm that the pair ai{t,e) = f (x(t, e), M(t)) and bi(t, e) = B(tg(c(e)), 
where t G [to,''"], is an A-homotopy. Similarly, from lemma [72] we conclude that a.2{t,e) = 
ef (x(t + te, e), ii(T -I- et)) and h2{t,e) = B(.^_,_j4).r(bi(r, e)) + if (x(r + et, e), n(r + et)), where 
t £ [0, 6t] , is also an A-homotopy. These homotopies are composable. Their composition (a, b) = 
(ai,bi) o (a2,b2) has the property that [a{t,e)t(z[to,T+eSt]] = [a{t,e)t(z[to,T+5t]] and the initial 
infinitesimal A-homotopy is equal to c(e). Moreover, b(r + 6t,0) = B(T+05t)T 
5tf (x(r), n(r)) = Brto (c(0)) + f (x(r), n(r))5t. 

2. Inductive step. Assume that the assertion holds for all /c < s. We will consider two 
possible situations: 

2.1 to < Tl < . . . < Tfc < Tfc+i = rfc+2 = ... = Ts = T. 

From the inductive assumption for tv = {Ti,Vi,T = Tk,Sti,6t = 0)i=i^,,,^k we know that 
there exist an A-homotopy (a(t, e), b(t, e)) (where t G [to,ti]) such that the initial infinitesimal 
homotopy is c(e), [a(t, e)^^^^- ^-j] = [a(t, e)](g[f(,^T-fc]] and the final infinitesimal homotopy satisfies 

k 

b(fi,0) = B,,to(c(0)) +Y,^r,n [ii^in),Vi) - f(x(Ti),u(Ti))]5ti. 

i=l 

We can decompose 

Recall first, that Ip = [t + e5t — e{5ts + • • • , Stp),T + e6t — e{5ts + . . . , (5tp+i)] =: [tp, tp + e5tp], 
where p = k + 1, . . . , s and that the control u^{t) equals Vp on the interval Ip. The last term in 
the above decomposition equals 

[a(t,e)tG[Tfc,T-|-£<5t]] = 

[{{x{t,e),u{t))t(,[r^:,r-e{5ti:+^+...+5ts-5t)]] [i{^{t,e),Vk+i)teh+i] ■■■ [f (x(t, e), w.)tG/J = 

([f (x(t, e), u{t))t(,[r^,,T]] [ - f (x(t, e),u{t))t(z[r,r~si5t^:+i+...+5ts-~5t)]] ) 

[f(x(t,e),?;fc+i)tG/fe+i] ••• [f(x(t,e),?;^)tg/J = 
[f (x(t, e), u{t))t^[r^:,r]] [ - ef (x(r + te, e),u{T + te))tg[o _(5tfc+i-f...+5t,-5t)]] 

[ef (x(tfe+i + te, e),Vk+i)te[o,stk+i]] ■ ■ ■ [^f (x(is + te,e),Vs)te[o,5ts]] ■ 
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Observe that the above expression is the composition of several families of A-paths of which 
the first is of the form from lemma 17.11 and other of the form of lemma I7.2[ In light of those 
lemmas each of the factors can be regarded as A-homotopy, provided that one chose initial 
infinitesimal A-path (to be precise we have to modify the result from lemma 17.21 a little bit - 
instead of the flow B^^ associated with the control u(t) one has to take a flow associated with 
a constant control Vi). The natural idea is to choose this initial paths in such a way that these 
homotopies are composable and, moreover, the resulting composed homotopy can be composed 
with (a(t, e), b(t, e)). Indeed, all one has to do is to choose initial path of each factor to be equal 
to the final path of the former factor. The resulting homotopy has desired properties. Its initial 
infinitesimal homotopy equals c(e) and the final homotopy at e = satisfies 

d«(0) = B^,Jb(fi,0)) - f(x(T),n(T))(5tfc+i + ...5ts-6t) + 
f(x(rfc+i),?;fc+i)(5tfc+i + . ..i{^{Ts),Vs)6ts = 

k 

= B;V, {bI,^ (c(0)) + Bl,^ [{{^{n),v,) - f (x(r,), n(T,))] du) + 

i=l 

s 

+ J2 m^{ri),Vi)5ti-i{^{Ti),u{Ti)]6ti + i{^{T),u{T))St = 
i=k+l 

k 

= B«,„ (c(0)) + Kn [n^in),Vi) - f (x(r,), n(r,))] 6U + 
1=1 

s 

+ J2 B-^4f(x(Ti),t;,),5t, -f(x(r,),n(r,)]5t, + f(x(r),n(r))5t = 

i=k+l 

s 

= B;^,„ (c(0)) + Y [n^in),Vi) - f (x(r,), n(r,))] 6U + f (x(t), u(T))5t. 
1=1 

□ 

2.2 to < Tl < • • • < Tfc < Tfc + i = Tk+2 = . . . = Ts < T. 

In this situation we may write 

[a.{t,e)t(z[to,T+e5t]\ = [^it^(^)te[to,T,]\ [a{t,e)t(z[r,,r+e5t]\- 

Using part 2.1 with tt) = {Ti,Vi,T = Ts,Sti,6t = 0)i=i^...^s, we may write the first factor as an 
A-homotopy, whereas the second one can be made into homotopy with the help of part 1. Their 
composition will be the desired A-homotopy. □ 

Remark 7.3. Observe that d"'(s) was constructed as a final infinitesimal A-homotopy, hence as 
a weak solution of some set of differential equations. These equations are continuous with respect 
to controls and trajectories. Consequently, for tr = {Ti,Vi,T, 6ti, 6t)i=i^,,,^s, the final infinitesimal 
homotopy d"'(s) depends continuously on Sti and 6t [ti, Vi and r are fixed). 

7.2 Proof of lemma 16. 6L 

Let x(t) = {x^{t),x{t)) and u(t), for t G [toi^i], be a solution of the optimal control problem. 
Assume the opposite to the thesis of lemma 16.61 that is that the ray Ax(t-) = M„ x {0} C 
T^O(^)M X = Ax(t-) lies in the interior of K" for some r G (toi^i) which is a point of 

continuity of u. We shall show that there exists a symbol to = {Ti,Vi,T, 6ti, 6t)i=i^,,,^s and a 
number e > such that the A-path d'^(s) = (^"(s), (i™(s)) constructed in the proof of lemma 
16.41 satisfies the following conditions: 

1. the projection d"'(s)se[o,e] of d"'(s)sg[o,e] to the algebroid E is homotopic to 0, 
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2. for every s S [0, e], (io'(s) - the TM-component of d"'(s), is smaller than 0. 

The existence of such an A-path will contradict the optimality of x(t) and u{t). Indeed, de- 
note by u^{t) the variation of the control u{t) associated with the symbol ro. Let x(t,e) = 
[x^{t,e),x(t,e)) be the solution of the differential equation 

dtx{t,e) = pA{i{^it,e),u^{t)) 
x(to,e) = xq. 
From lemma [631 we know that 

[f(x(t,e),n,"'(t)),g[,„,,+,5,]] = [f(x(t),n(t)),g[,„,,]][d"'(s),g[o,,]]. (32) 
After projecting this equality to E we will get 

[f{x{t,e),u^{t))t^[t^^^+,st]] = [f{xit),u{t))te[t,^r]] [O] • 

Clearly, x{t + e6t,e) = x{t). What is more, x^{T + e5t,e) < x^{t). Indeed, projecting ([32]) 
to the algebroid TM we get 

[L(x(t, £),Ue{t)t(.[ta^r+eSt]\ = [-^^(a^W, ^^(i))tG[to,r]] K('5)sG[0,e]] ■ 

Since (io'(s) < 0, we have 

e) = / L{x{s , e) , Ue{s))(ls = / L{x{s),u{s))ds+ d™(s)ds < / L{x{s),u{s))ds = x 
Jto Jto Jo Jto 



Now, consider a new control 

u*{t) = 

and the solution x*(t) = (x^* (t) , x* {t)) of the differential equation 



uf{t) for t £ [to, T + e5t] 

u{t - e5t) for t £ [t + e6t, h + e5t] 



9tx*(t)=pA(f(x*(t),n*(t)) 

X*(to) = Xq. 

Observe that 

x*ft) = J^'-*'^-' for t G [to,T + e(5t], 

\x{t-e6t) for t£[T + e6t,ti+e6t]. 

The pair (x*(f), M*(t)) contradicts the optimality of (x(t),u(t)). Indeed, 

[f{x*{t),U*{t))t^lt^^ti+e5t]] = [fix*{t),U*{t))t(z[tg^r+e5t]] [f (x* (t) , U* {t))t(.[r+e5t,tj+eSt]] 

= [f{x{t, e), uf{t))t(zito^r+s5t]] [f{x{t - e6t), u{t - e8t))t^^^^^st,t^+e5t\\ 

= [/(a^(0>'«(i))te[to,r]] [/(a^W.'"(i))tGMi]] = [/(a^W, '"(i))tG[to,ti]] > 

hence the homotopy classes in E agree. 

Second, the cost on the trajectory x*{t) is, however, smaller than that on x{t) 

pti+eSt pT+eSt pti+eSt 

/ L{x*{s),u*{s))ds = / L{x{s,e),uf{s))ds+ / L{x{s - e6t),u{s - e6t))ds < 
Jto Jto J T+eSt 

r-T+eS pti r-ti 

< / L{x{s),u{s))ds + / L{x{s),u{s))ds = / L{x{s),u{s))ds. 

Jto J T J to 
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What is now left to prove is the existence of a symbol ft) satisfying 1. and 2. Choose a vector 
A = {—dt,0) € T^jOj-^jM X = Ax(,-) spanning the ray Ax(t-) . Since we assumed that Ax(,-) lies 
in the interior of K", there exists a basis (ei, . . . ,e.m) of {0} x E^^^^-^ C Ax(t-) such that vectors 
A, A + e^, A — Bi lie in K" for i = 1, . . . , m. Consequently, there are symbols ft), ft)j, Dj, such that 
d'^(O) = A, d"'' (0) = A + and d'''(0) = A — for i = 1, . . . , m (this is not completely true - 
compare remark 1731) . We deal with a finite set of symbols, hence we can assume that they all 
are of the form ft) = {Ti,Vi,T, 6ti, 6t)i=i^,,,^s, where r,, Vi are fixed, and differ by 6ti and 6t (we 
can always add triple {Ti,Vi,6ti = 0) to a symbol without changing anything - compare remark 
16. 3p . Introduce functions 

, I r for r > 0, , _ / n I for r > 0, 

I for r < 0, I — r for r < 0. 

For r = r^Gi such that X](r*)^ < 1, we may define a new symbol 

"'(^^) =^^-iEy\>+ii: +^11 h~('>^- 

Here the convex combination of symbols is defined using the rule 

u{Ti,Vi,T, (5t)i=l,,,,,s + fl{Ti,Vi,T, dt'i, (^t')i=l,...,s = {Ti,Vi,T, v5ti + v5t + /U(5t')i=l,,,,,s. 

It is straightforward to see (compare lemma [63]) that for this new symbol 

d"'(^^)(0) = A + — r. 

m 

Moreover, due to remark FTSl d"'('')(s) depends continuously on r. Every admissible path d"'('')(s) 
is defined only on a finite interval s € [0,^(r)]. It follows from the proof of lemma WM that 
9{r) depends continuously on the positions of switching-points Tj and numbers 5ti in a symbol 
ft)(r) = {Ti,Vi,T,6ti,6t)i=i^,,,^s. So that since these are continuous with respect to r, and it be- 
longs to a compact set {X]r*ej : XK'"*)^ — ^Ij ^ '^^^ be chosen universally for all fs. Since 
the TR-th component of d"'^'') (s) is continuous with respect to f and s and is equal —dt at 
s = 0, we may assume (after shrinking 6 if necessary) that it is smaller than for every s € [0, 6]. 
Thus all curves d"'(^(s) satisfy condition 2 and we can thus concentrate ourselves on condition 1. 

After projecting d"'(^(s) from A to E, we obtain a family of continuous admissible paths 
d^^^{s), with s G [0,^] and continuously parameterized by r G B{0,1) C M™, satisfying 
d«'(^-0(O) = ^fGM-«E,(,). 

Since we are only interested in -E-homotopy classes of these curves (perhaps after restricting 
s to the smaller interval [0,e] C [0,^]), using the reparameterization lemma H. 121 we may assume 
that 9=1. After possible rescaling the basis of ^'^^(t-) we can assume that (i«'(^)(0) = f G f« 

It will be convenient to extend this basis to a basis of local sections of E and to introduce 
local coordinates (x") on M around the point x(r) = 0. In this way we have constructed local 
coordinates (a;",y*) on E. As usual, p^ix) and c*^(a;) will denote the structural functions of the 
algebroid E in this coordinates. Since these are smooth, we can assume that they are bounded 
(by a number Cp and Cc respectively) and Lipschitz (with constants Lp and Lc respectively) 
with respect to 

The following proposition will finish the proof. 

Proposition 7.4. Let [0, 1] 9 t ^ a^(t) be a family of continuous admissible paths, continuously 
parameterized by vectors f G B{0, 1), such that r£;(a^(0)) = and af{0) = f for each f G -6(0, 1). 
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There exists a vector f and a number e G (0, 1] such that the curve a^{t), after restricting to the 
interval [0,e], is E-homotopic to the null path 

Proof. Assume the contrary. We are interested in controlling the homotopy classes of admis- 
sible paths. The idea is to build a map which will allow us to index these classes (locally). 

Denote by C^^^^ih^^) the Banach subspace of (7*^(1, R™) consisting of curves a{t) which 
satisfy the condition a{t)dt = 0. Denote by Cf?(t) the path constantly equal to r. 

We will build a map 

defined on some open neighbourhood Uq of (0,0) in M'" x C^^q{I,W") with the following 
properties. 

A <I> maps (f, 0) into a constant path G (7*^(1, M™). 
B $ is a continuous map of Banach spaces. 

C The i?-homotopy class of the curve $(r, d) is determined by f, that is: 

[$(f,d)] = [$(f,0)] [c^]. 
D The map ^{f, d) := $(r, d) — (c,-? + d) is Lipschitz with constant |. 

E The map $ posses continuous inverse defined on some open neighbourhood Vq 9 in 
C^{I,W^). Moreover, is Lipschitz with constant 6. 

We will finish the proof of proposition 17.41 showing the existence of the map $. Indeed, ajf{t) 
is continuous with respect to both: r and i, and o^(t) — r ^ as i — > 0, hence there exists a 
number e > such that |a^(t) — R\ < j2 for every t G [0,e] and every R G dB{0,l) C M™". 
Consequently, for every t G [0, 1] and R G dB{0, 1), 

|a^(t) - eR\ < ^e, 

where a^(t) := ea^{et). The number e can be chosen so small that for every r G -6(0, 1) the curve 
lies in Vq. Prom lemma 121 we deduce that 

[^r(0]fg[o,i] = [M*)](g[o,e]- 

Since we assumed that the thesis of proposition 17.41 is not satisfied, these classes are different 
from 0. 

The family a^(t) was continuous, hence so is af^{t). Consequently, we have a continuous map 

D 5(0, 1) ^ Vb C C°(/,M"^), 
r I — > a^. 

Composing ^ with we will obtain a continuous map 

B(0, 1) X C^^q{I,W^). 
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Since $ has the property C of preserving the £^-homotopy classes and since we assumed 
that [af] / [O], the map V maps the ball B{0,1) C continuously into - {0}. Since 
c oil < for R G dB{0,l), using the Lipschitz condition for $ ^ (property E) and the 



fact that $ ^(cr^) = (^jO) (property A), we obtain 

\ij{R) - eR\ < \^{R) - eR\ + \\(p{R) - 0|| = ||$-^ 



c^-i(c 



< 6||a 



R 



n 1 



Consequently, the set ip{dB{0,l)) is not contractible in M*" — {0}, as it is homotopic to the 
circle edB{0,l) in M"" - {0} {h{R,s) = STp{R) + (1 - s)e^ is the homotopy). On the other 
hand, {s,R) i— ip{sR) is an obvious contraction in im{ip) C M'" — {0}. This contradiction proves 
proposition 17.41 □ 
Constructions of the maps 

Now we should construct the map $ which satisfies conditions A - E. 

Consider an affine differential equation for a curve {a{s), x{s)) in M"* x M" with parameters 
b,d £ and initial conditions ao, xq 



(33) 



Let |^G(s, ao,XQ, b, d), H{s, xq, b)j be a general solution of this equation. Since the right hand 

side of ([33]) is smooth with respect to all variables and parameters, the general theory of ODE's 
guarantees (confront for example [2]) that functions G and H are well defined and smooth on a 
sufficiently small neighbourhood J x f/^ x [/^ x x [/^ of (s = 0, ao = 0, xq = 0, 6 = 0, d = 0). 
Observe that (f33l) is homogenous of order 1 with respect to b and d. Consequently 

G{\s, ao, Xq, b, d) = G{s, ao,xo, Xb, Xd); 
H{Xs, Xq, b) = H{s, Xq, Xb). 

We deduce (after shrinking Ub and Ud if necessary) that G and H are well defined and smooth 
on an open neighbourhood (—2,2) xUa^ x Ub x Ud of (0,0,0,0,0). 

Take now any path a G CO(/,R™) and d G G^^^q{I,R"'). Let us define b{t) = Jq d{s)ds 
(mind that 5(0) = 6(1) = 0). Let x{t) be the solution of the equation 





= d^ + c],{x{s))a^s)b 


a\0) 




dsx\s) 


= p\{x{s))b\ 


. ^'(0) 


— Xq. 



(34) 



r dtx'^it) = pt{x{t))a'it) 
\ x{0) = 0. 
We define a curve 

^(a,d)(t) := G{l,a{t),x{t),b{t),d{t)). 

Is is clear that if ||a|| and ||d|[ are sufficiently small, the curve ^(a, d) is well defined and con- 
tinuous. Moreover, ^(s,(i) is an admissible path covering H{1, x(t),b{t)) and it is E'-homotopic 
(with fixed end points) to an admissible path a{t) covering x(t). 

Indeed, the -E-homotopy condition becomes clear if one observes that (^^{a, d)(t),H{l, x{t), b{t)) 

is by definition the solution ( a(t, s), x(t, s) ) of the differential equation 



dsa\t,s) = dtb\t) + cif,{x{t,s))a^{t,s)b^{t) 

a{t,0) = a{t) 
dsX%t,s)=pnx{t,s)W{t,s) 

x(t,0) = x{t) 
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taken at s = 1, where b{t) satisfies the conditions b{0) = 6(1) = (compare the definition 14.11 of 
-E-homotopy). 

To sum up, we have obtained a map 

C°(/,M") X C7^^o(/,M™) dWo^ C7°(/,M™) 

defined on some open neighbourhood Wq B (0,0) in CO(/,M™) x C°^=o(/,M™). We shall now 
prove the following properties of 

Al ^-(0,0) = a. 

Bl ^' is a continuous map of Banach spaces. 

CI The i?-homotopy class of curve "^{a,d) is determined by a, that is 

[*(a,d)] = [^ia,0)] ^ = ^ [a]. 

Dl The function ^'(a, d) := ^'(a, d) — {a + d) is Lipschitz with constant |. 

The property CI has already been proven. The property Al is clear, as ^{a, 0) is the solution 
of the differential equation dsa{t,s) = with initial condition a{t,0) = a{t). Condition Bl will 
follow from Dl. Indeed the map (a, d) i— > (a + d) is continuous, and if Dl holds, the map \I' is 
Lipschitz, hence also continuous. We can thus write ^{a, d) = ^{a, d) + {a + d) as a sum of two 
continuous maps. 

Proof of property Dl. Let (a,d) and {a ,d) be two elements of Wq. Denote by 6(t), b (t), 
a{t,s), a {t,s), x{t,s) and x {t,s) the curves and maps defined as above associated with each of 
these elements. Define 

6a{t, s) := a{t, s) - {a{t) + sd{t)), 
6a{t,s) := a{t,s) - {a (t) + sd'{t)). 

Clearly, $(a,d) = 6a{t,l) and $(o',d') = 6a'{t,l). 

Our goal is to estimate the difference \Sa{t,s) — 6a {t,s)\. We will start with proving the 
following statement: 

\\b-b'\\ <\\d-d'\\. (35) 

Indeed, 

\b{t) - b' {t)\ = \ (^d{s)-d'{s)^ds\< \d{s)-d'{s)\ds<\\d-d'\\. 
Now we shall prove that 

sup\x{t,s) -x'{t,s)\(l- Lp\\d\\) <Cp\\d-d'\\. (36) 
(t,s) ^ ^ 

Observe that x{t,s) (and analogously x'{t,s)) satisfies the integral equation 

x'>{t,s) = r p\{x{t,a))U{t)da. 
Jo 
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Consequently (for simplicity we omit the indices in the calculations), 



\x{t, s) — X {t, s) 



< 



< 



p{x{t, a))h{t) - p{x (t, a))b (t) ) da 



p{x{t,a))b{t)- p{x {t,a))b (t) 



< 



da < 



p{x{t,a))- p{x {t,a))]b{t) 



da + 



p{x {t,a))[b{t)-b{t) 



< Lpsup \x{t, s) — X (t, + Cp\\d — d \\. 



{t,s) 



Next we will show that 



sup|a(t, s)|fl - Cc||d||) < ||a|| + 
{t,s) ^ ^ 



Observe first that a{t, s) satisfies the integral equation 



a\t,s) = a\t) + J d'{t) + c]i,{x{t,a))a^ {t,a)b''{t)da. 



da < 
(37) 

(38) 
(39) 



Consequently, 

\a{t,s)\= a{t)+ j d{t) + c]^{x{t,a))a{t,a)b{t)da 



< \\a\\ + 



+ 



< 



c)i,{x{t,a))a{t,a)b{t) da < |a|| + ||d|| + Cc sup |a(t, s 

{t,s) 



From estimations (f36]l and ([38]) we see that if we take \\d\\ sufHciently small (that means if we 
possibly shrink the set Wq), we may assume that 



sup \x{t, s) — x {t, s)\ < 2Cp\\d — d \\ and 

{t,s) 

sup|a(t,s)| < 2||a|| +2||d||. 

(t,s) 



(40) 
(41) 



Prom ([39]) we deduce that 6a{t, s) satisfies 



Sa\t,s)= / dk{x{t,a))a^{t,a)b''{t)da. 
Jo 



We deduce further that 

\6a{t, s) — 6a {t, s)\ 



< 



< 



c)k{x{t,a))a{t,a)b{t) - c]j,{x {t,a))a {t,a)b {t)]da 



< 



+ 







djki^it, cT))a(t, a)b{t) - c}k{x' {t, a))a' {t, a)b' (t) 

4fc(^(*'^)) -4fc(^'(*'^)) Ht,a)b{t)\da+ 
1 

4fc(x' {t, a))\a{t, a) - a (t, a) |6(t) |da+ 



da < 



+ I \c)k{x it,a))\a {t,a)\b{t) -b{t)\da 

10 
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The latter is obviously smaller than 

Lc sup \x{t, s) — X {t, s) \ sup \a{t, s)\\\d\\+Cc\ \\a — a \\ + \\d — d \\ + sup \6a{t, s) — Sa {t, s)\]\\d\\ + 

{t,s) {t,s) ^ {t,s) ' 

+Cc sup \a {t, s)\\\d — d \\. 
The last inequality combined with ([^0]) and (IHI) gives 

sup \Sa{t, s) - 6a' {t, s)\(l - CM\) < \\d - d' \\ (4L,Cp{\\a\\ + ||d||)||(i|| + ^^11 + 2C,{\\d \\ + \\d' \\) + 

{t,s) \ / \ / 

+ ||a — a ||Cc||d||. 

We see that if we restrict ourselves to ||a|| and ||ci|| small enough (that means if we possibly 
shrink the set Wq on which ^ is defined) we will get 

\\'^(a,d) - ^{d ,d')\\ < sup \6a(t,s) - 5a'(t,s)\ < - (\\a - all + \\d - d' \\) . 

{t,s) 6 V J 

This proves the property Dl. □ 
Having defined the map we can finally define <^>: 

$(f,d) := ^{ci^,d). 

Since the map 9 r i— > € C^{I,W^) is Lipschitz with constant 1, the properties A - D of 
<I> easily follow from the analogous properties Al - Dl of We will now prove the property E. 
Proof of property E. As one might have expected the existence and the Lipschitz condition for 
will be proven essentially the same as in the standard proof of the inverse function theorem 
(confront [TH]'l. 

First of all, we will establish a pair of linear isomorphism between Banach spaces: 
C°(/,M") ^M™ X CO^^o(/,M"), 

a{t) I — > ^ j a(s)ds, a{t) — j a{s)dsj 

and 



X C:^^o(/,M'^) ^ C°(/,]R'"), 
{r,d{t)) I — > Cr^ + d{t). 

It is straightforward to verify that a and P are continuous inverses of each other and that a is 
Lipschitz with constant 3. 

The map $ is defined on some open neighbourhood Uq 9 (0,0). Take R such that the 
open ball B{0,2R) C Uq C W x C^^q{I,W^). The map 5 is Lipschitz with constant ^ and 
a is Lipschitz with constant 3, hence a o $ is Lipschitz with constant ^ and it maps the ball 
B{0,2R) C Uo into a ball B{0,R). 

Take now any a € C°(/, M™) such that ||a|| < -j. We shall construct an unique element 
(r,d) € B{0,2R) C Uq satisfying $(r,d) = a. _ 

Indeed, consider a map ^ai^,d) = a{a — ^'(r, c?)). It follows easily from the properties of a 
that $a maps the ball -6(0, 2R) into itself, and is Lipschitz with constant |. Now using the Banach 
theorem for contracting maps, we deduce that has an unique fixed point {f,d) S B{0,2R). 
Consequently, a — <^(r, d) = /3(<I>a(r, d)) = j3{f,d) = + d, hence a = ^{r,d). We have proven 
the existence of <I>~^. 
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Take now a, a eC^{I,W^) and let $-^(a) = (r,d), $"^(0 ) = {r,d'). Using the Lipschitz 
condition for a and we get 

\\{f,d)-{r,d')\\ = \\^a{f,d)-^^>{r,d')\\ = ||Q(a-$(f,c?)) - a(a' - $(r , c?')) || < 

< 3||a-a'|| +3||$(f,d) -$(r < 3||a-o'|| +3-||(f,d) - (r,d')\\. 

6 

At the end 

\\^-\a) -<^-\a)\\ = \\{r,d)-{r,d')\\ <6||a-a'||. 

The property E has been proven. □ 
This finishes the proof of proposition 17.41 and, in consequence, lemma 16.61 and the whole 
Maximum Principle. □ 

Remark 7.5. In the proof we assumed that there exist symbols tr, roj, such that y"'(0) are 
A and A it e^. This was not completely true, since K" is defined as a closure of the space of 
all d"'(0)'s. However, what was really important in the proof was the existence of the family of 
continuous paths d"'(^ (t) parameterized by a convex set B 3 f such that the set of elements 
d*^('T(0) covers the set {A} x [/ C M x M'", where U is an open neighborhood of zero in M"^. We 
can always choose symbols ro, roj, such that d"'(0)'s are arbitrary close to A and A ± Cj. It 
is clear that the set of elements d"'^'^(0) with tv{f) defined as in the above proof will have the 
desired properties. 



8 Examples. 

8.1 Pontryagin Maximum Principle for non-autonomous control systems. 

Consider now a time dependent optimal control problem on an AL algebroid E. Assume, namely, 
that our control and cost functions depend on one additional real parameter (time): f : M x 
R X U — > E, L : M xR X U — > R. We assume that the dependence of both, / and L, on 
the additional parameter is of class C^. Our problem is to find an admissible control u{t) with 
t G [^Oj^i] (this time the interval is fixed), such that the associated trajectory f{x{t),t,u{t)) is 
equivalent to a class [a] of fixed E'-path a with initial base-point xq and, moreover, the total cost 
fl^^ L{x{t),t,u{t))dt is minimal among all such controls. (Here x{t) is of course the solution of 
the differential equation x{t) = p(^f{x{t),t,u{t))^ with initial condition xq). 

In the above situation the following version of the Pontryagin Maximum Principle holds. 

Theorem 8.1. Let u : [to,ti] — > U be a solution of the above optimal control problem. There 
exists a curve z : [toi^i] — * E* (with initial base-point xq) and a number zq < such that: 

• the curve z{t) is a trajectory of the time- dependent family of Hamiltonian vector fields Xhi 
associated with the Hamiltonians Ht{z) = H(z,t,u{t)) , where 

H{z, t, u) = (f {TT{z),t, u) , z)^ + zqL (7r(z), t, u) ; 

• the pair u{t) and z{t) satisfies the "Maximum Principle" 

H{z{t),u{t)) = sup H{z{t),v) 
veu 

at every point of continuity of the control u; 

• if Zq = the covector z{t) is nowhere-vanishing; 
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• ^H{(^{t),u{t)) = Zi{t)^^{x{t),t,u{t)) + ZQ^(yx{t),t,u{t)) at every point of continuity of 
the control u. 

Remark 8.2. Observe that in particular for time-independent optimal control problem with 
fixed time interval [toi^i] the last condition means that H{z{t),u{t)) is constant with respect to 
t. Whereas for the free interval we know that H{z{t),u{t)) = (compare theorem ll.lj) . 

Proof. The above time-dependent optimal control problem on E can be £egarded as a time- 
independent problem on an algebroid E x TM with modified control function / = (/, 1) : M x M x 
U — > E X TM. Observe that the pair [a], [to,ti] determines an equivalence class of admissible 
paths in X TM (admissible path in a product algebroid is a pair of admissible paths on its 
components, and the equivalence class in TM is determined by two points in M as M is simple- 
connected). Now, using the theorem 11.11 for an algebroid E x TM, we know that there exists a 
number zq < and a curve {z{t),(,{t)) £ E* x T*M (with initial base point {xo,to)) which is 
Hamiltonian with respect to 

H{z,i,u) = {f{'K{z),TT^{i),u),z)^ + + ZoL{TT{z),-K^{i),u) = (z, TTr (^) , u) + ^. 

The evolution of 7r]R(^(t)) is given by an equation dt'K^{£,{t)) = 1 with initial condition vr]R(^(to)) = 
to, hence 7rK(^(t)) = t. It follows easily, that the evolution of ^(t) is given by an equation 

d P dL 

= -Z^{t)^{z{t),t,u{t)) - ZQ — {z{t),t,u{t)). 

On the other hand we know that H{z{t),(,{t),u{t)) = H{z(t),t,u{t)) + (,{t) = at every point 
of continuity of control u. Consequently H(^z{t),t,u{t)^ = —^{t). □ 

8.2 The falling cat problem. 

Consider the following problem. Let M be the Riemannian manifold with metric g and let 
G — > Q — > M be the principal G-bundle over M. Let ^ be a given G-invariant connection on 
Q. We are looking for a curve q{t) G Q (where t € [0, 1]) joining two fixed points qo and qi in 
Q which is horizontal with respect to A and such, that x{t) - its projection to M minimizes the 
energy integral 

1 

g[x{t),x{t)^dt — > min. 

In literature this problem is called the Falling Cat Problem or the Isoholonomic Problem 
(compare [5] and [HI chapter 7.1]) and is solved with help of the Lagrange multipliers technique. 
We will treat it as the optimal control problem on Lie algebroid of G-invariant vector fields on 
Q (so called Atiyah algebroid) E := JQ/G. 

First of all observe that the Falling Cat Problem can be regarded as an optimal control 
problem on JQ. If q{t) is a horizontal curve it is determined by an initial point q{Q) and the base 
path x{t). Consequently, taking base velocities as control parameters every horizontal curve can 
be treated as a trajectory of the control system on JQ with control function F{q,u) = h_A{q,u) 
- the horizontal lift of the base velocity to TQ. The condition of minimizing the energy integral 
can be interpreted in this language as looking for an optimal trajectory of the system F with 
the cost function L{q,u) = ^g{TM{q)){u,u) . Now it follows from the G-equivariance of F and 
G-invariance of L that this optimal control problem projects to the optimal control problem on 
JQ/G with fixed time interval [toj^i] = [0,1] and homotopy class of E'-paths determined by 
points go, 91 G Q- 

Choose local coordinates (x") on M. We have the induced coordinates (x",i;'') on TM. 
Denote by gah{x) the coordinates of the metric g. As we said before base- velocities =: will 
serve as our control parameters. Consequently the set of control parameters is C/ = M". 
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If we fix a local trivialization of Q it is possible to identify the Atiyah algebroid E = JQ/G 
with a bundle TM x g — > M equipped with a product Lie algebroid structure (here g stands of 
course for the Lie algebra of the group G). Hence we have local coordinates {x'^,u^,y^) on E. In 
this coordinates the anchor is = 6^, Pi{x) = and the bracket equals c*^ - the bracket on 

g. Since the connection is G-invariant it projects to E. Every horizontal vector is of the form 

f{x,u) = {x\u\-A',{x)v'), 

where A\^{x) is the g valued form of the connection A. The function / is a control function of 
our control system on E and L{x,u) = ^gah{x)u°'v}' is the cost function. 

Let us now use the Pontryagin Maximum Principle (version [8. Assume that {x{t),u{t)) is 
the solution of the optimal control problem on E. We know that there exists a number -zq < 
and a curve (x"(t),pb(t), .^j(t)) € T*M x g* with the following properties. 

The evolution of Pb{t) and ^j(t) is given by the equations 

1 dt^^it) = -c%Ai{x)u\t)Ut) 
Moreover, the Hamiltonian 

H{x{t),p{t),m,v) = Pb{t)v' - mAi{x)v'' + zo^gab{x)v''v'', 

takes its maximum at f = u{t) and, what is more, H(^x{t),p{t),^{t),u{t)) is constant in time. 

Prom the maximum condition it follows that Pa{t) ■= Pa{t) — Al^{x)^i{t) = —Zogab{x)u''{t). It 
is now straightforward to verify that the following equations are satisfied. 

^' dtPbit) = -Bl{x)u-m{t) - zo^^^u'^itXit), 

. = -^Aiixymit), 

where B^^f^{x) is the curvature of the connection A. In the normal case zq = —1 we recognise the 
Wong equations ([5l|3]). Note that the condition H{z{t),u{t)) = const implies that zogab{x)u"-u^ 
is constant, hence in the normal case the velocity is constant on the optimal trajectory. 

8.3 Time-optimal problem on so(3). 

Consider now a rigid body in M"^ which can rotate with constant angular velocity along two 
fixed axes in the body. At every moment the position of the body is described by an element 
q € SO {3). The rotation axes can be represented by elements of the Lie algebra of 50(3) 
l+,l- S so(3). The rotation along the axis l± is described by an equation: 

dtq = ql±. 

It would be suitable to write 1+ = a + b and = a — b. The above equation can be 
regarded as a control system on a Lie group SO (3) with control function F{q,u) = qf{u), where 
f{u) = a + ub and the set of controls is simply U = {—1, 1}. We would like to find the control 
u{t) which moves the body from the position qo G 50(3) to qi £ SO{3) in the shortest possible 
time. 

It is obvious that the above optimal control problem on a Lie group reduces to the optimal 
control problem on a Lie algebra so (3) with control function / and cost function L = 1. 

Fix a basis (ei, 62, 63) on so (3) and denoted by c*^ the structure constants of the Lie algebra 
in this basis. Using theorem 11.11 we will obtain the following result. Let u{t) for t G [ioj^i] be 
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the solution of the above optimal control problem. There exist a number zq < and a curve 
z{t) G so(3)* such that. 

H{z{t),u{t)) = (z{t),a + u{t)b) + zo = max {z{t), a + vb) + zq. 

This implies u{t) = sgn (^{z{t),b)). Moreover the evolution of z{t) is given by the equation 

dtzj{t)=c'i^{a'+u{tp)zk{t). 

We have obtained the same equation as in ([H section 19.4]). We refer to this book for the 
detailed discussion on solutions. 
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